Aug 05 10:18:49 devstack cinder-volume[77466]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 05 10:18:49 devstack cinder-volume[77466]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 10:18:49 devstack cinder-volume[77466]: we strongly recommend against using it for new projects. Aug 05 10:18:49 devstack cinder-volume[77466]: If you are already using Eventlet, we recommend migrating to a different Aug 05 10:18:49 devstack cinder-volume[77466]: framework. For more detail see Aug 05 10:18:49 devstack cinder-volume[77466]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 10:18:49 devstack cinder-volume[77466]: import eventlet # noqa Aug 05 10:18:52 devstack cinder-volume[77466]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 10:18:52 devstack cinder-volume[77466]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 10:18:52 devstack cinder-volume[77466]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 10:18:53 devstack cinder-volume[77466]: INFO dbcounter [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Registered counter for database cinder Aug 05 10:18:53 devstack cinder-volume[77466]: DEBUG oslo_db.sqlalchemy.engines [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77466) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:18:54 devstack cinder-volume[77466]: DEBUG dbcounter [-] [77466] Writer thread running {{(pid=77466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 10:18:54 devstack cinder-volume[77466]: INFO cinder.rpc [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 05 10:18:54 devstack cinder-volume[77466]: INFO cinder.rpc [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 05 10:18:54 devstack cinder-volume[77466]: DEBUG oslo_db.sqlalchemy.engines [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77466) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:18:54 devstack cinder-volume[77466]: INFO cinder.volume.manager [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Determined volume DB was empty at startup. Aug 05 10:18:54 devstack cinder-volume[77466]: DEBUG cinder.volume.manager [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77466) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 05 10:18:54 devstack cinder-volume[77466]: INFO cinder.volume.manager [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 05 10:18:54 devstack cinder-volume[77466]: WARNING stevedore.named [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 10:18:54 devstack cinder-volume[77466]: WARNING castellan.key_manager [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 10:18:54 devstack cinder-volume[77466]: WARNING cinder.keymgr.conf_key_mgr [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 10:18:54 devstack cinder-volume[77466]: DEBUG cinder.volume.drivers.lvm [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77466) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 05 10:18:54 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:54 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] CMD "cinder-rtstool verify" returned: 0 in 0.435s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:54 devstack cinder-volume[77466]: DEBUG oslo_db.sqlalchemy.engines [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77466) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:18:54 devstack cinder-volume[77466]: INFO cinder.rpc [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 05 10:18:54 devstack cinder-volume[77466]: INFO cinder.rpc [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 05 10:18:54 devstack cinder-volume[77466]: WARNING stevedore.named [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 10:18:54 devstack cinder-volume[77466]: WARNING castellan.key_manager [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 10:18:54 devstack cinder-volume[77466]: INFO cinder.volume.manager [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_db.sqlalchemy.engines [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77466) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:18:55 devstack cinder-volume[77466]: INFO oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Starting 1 workers Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Started child 77631 {{(pid=77466) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Full set of CONF: {{(pid=77466) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] ******************************************************************************** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Configuration options gathered from: {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] ================================================================================ {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] allow_availability_zone_fallback = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77631]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] allow_compression_on_image_upload = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] allowed_direct_url_schemes = [] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] api_rate_limit = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] auth_strategy = keystone {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] az_cache_duration = 3600 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_availability_zone = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_host = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_name = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_stats_polling_interval = 60 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backup_api_class = cinder.backup.api.API {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backup_name_template = backup-%s {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backup_use_same_host = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backup_use_temp_snapshot = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] chap_password = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] chap_username = {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cinder_internal_tenant_project_id = 732db3173e8243b8bde170f8823fdedb {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cinder_internal_tenant_user_id = 98e715250139425ba44b5a4cc0cbf18d {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cloned_volume_same_az = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cluster = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] compression_format = gzip {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] compute_api_class = cinder.compute.nova.API {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] config_dir = [] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] config_source = [] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] control_exchange = openstack {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] debug = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] default_availability_zone = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] default_group_type = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] default_volume_type = lvmdriver-1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] disk_geometry = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] driver_client_cert = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] driver_client_cert_key = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] driver_data_namespace = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] driver_ssl_cert_path = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] driver_ssl_cert_verify = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] driver_use_ssl = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] enable_force_upload = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] enable_new_services = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] enable_unsupported_driver = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] enforce_multipath_for_image_xfer = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] filter_function = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance_api_insecure = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance_api_servers = ['http://192.168.122.13/image'] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance_api_ssl_compression = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance_ca_certificates_file = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance_catalog_info = image:glance:publicURL {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance_certfile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance_keyfile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance_num_retries = 3 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance_request_timeout = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] goodness_function = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] graceful_shutdown_timeout = 5 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] group_api_class = cinder.group.api.API {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] host = devstack {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] image_compress_on_upload = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] image_conversion_address_space_limit = 1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] image_conversion_cpu_limit = 60 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] image_conversion_disable = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] image_upload_use_cinder_backend = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] image_upload_use_internal_tenant = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] image_volume_cache_enabled = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] image_volume_cache_max_count = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] image_volume_cache_max_size_gb = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] init_host_max_objects_retrieval = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] instance_format = [instance: %(uuid)s] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] iscsi_target_flags = {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] iscsi_write_cache = on {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] iser_helper = tgtadm {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] iser_ip_address = 192.168.122.13 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] iser_port = 3260 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] log_color = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] log_config_append = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] log_dir = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] log_file = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] log_options = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] log_rotate_interval = 1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] log_rotate_interval_type = days {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] log_rotation_type = none {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] max_age = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] max_logfile_count = 30 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] max_logfile_size_mb = 200 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] max_over_subscription_ratio = 20.0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] message_reap_interval = 86400 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] message_ttl = 2592000 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] migration_create_volume_timeout_secs = 300 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] monkey_patch = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] monkey_patch_modules = [] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] my_ip = 192.168.122.13 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] no_snapshot_gb_quota = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] num_iser_scan_tries = 3 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] num_shell_tries = 3 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] num_volume_device_scan_tries = 3 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] nvmeof_conn_info_version = 1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] nvmet_ns_id = 10 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] nvmet_port_id = 1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] osapi_max_limit = 1000 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] osapi_volume_ext_list = [] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] osapi_volume_listen_port = 8776 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] osapi_volume_use_ssl = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] osapi_volume_workers = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] per_volume_size_limit = -1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] periodic_fuzzy_delay = 60 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] periodic_interval = 60 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] public_endpoint = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] publish_errors = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] quota_backup_gigabytes = 1000 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] quota_backups = 10 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] quota_gigabytes = 1000 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77631]: INFO cinder.volume.manager [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 05 10:18:55 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] quota_groups = 10 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] quota_snapshots = 10 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] quota_volumes = 10 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] rate_limit_burst = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] rate_limit_except_level = CRITICAL {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] rate_limit_interval = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] reinit_driver_count = 3 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] replication_device = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] report_discard_supported = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] report_interval = 120 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] reservation_clean_interval = 86400 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] reservation_expire = 86400 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] reserved_image_namespaces = [] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] reserved_percentage = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] rpc_response_timeout = 120 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] run_external_periodic_tasks = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] scst_target_driver = iscsi {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] scst_target_iqn_name = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] service_down_time = 720 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] shell_completion = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] snapshot_name_template = snapshot-%s {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] snapshot_same_host = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] split_loggers = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] state_path = /opt/stack/data/cinder {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] storage_availability_zone = nova {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] storage_protocol = iSCSI {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] syslog_log_facility = LOG_USER {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] target_helper = lioadm {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] target_ip_address = 192.168.122.13 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] target_port = 3260 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] target_protocol = iscsi {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] target_secondary_ip_addresses = [] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] trace_flags = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] transport_url = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] until_refresh = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] use_chap_auth = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] use_default_quota_class = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] use_journal = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] use_json = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] use_multipath_for_image_xfer = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] use_stderr = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] use_syslog = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] verify_glance_signatures = enabled {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] volume_api_class = cinder.volume.api.API {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] volume_backend_name = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] volume_clear = zero {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] volume_clear_ionice = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] volume_clear_size = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] volume_copy_bps_limit = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] volume_dd_blocksize = 1M {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] volume_name_template = volume-%s {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] volume_service_inithost_offload = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] volume_usage_audit_period = month {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] zoning_mode = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_concurrency.disable_process_locking = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.auth_section = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.auth_type = password {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.auth_version = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.cache = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.certfile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.include_service_catalog = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.insecure = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.interface = public {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.keyfile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.memcache_password = {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.memcache_username = {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.region_name = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.service_type = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.13/identity {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.backend = dogpile.cache.null {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.backend_argument = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.backend_expiration_time = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.config_prefix = cache.oslo {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.debug_cache_backend = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.enable_retry_client = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.enable_socket_keepalive = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.enabled = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.expiration_time = 600 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.hashclient_retry_attempts = 2 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.memcache_dead_retry = 300 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.memcache_pool_maxsize = 10 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.memcache_sasl_enabled = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.password = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.proxies = [] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.redis_db = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.redis_server = localhost:6379 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.retry_attempts = 2 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.retry_delay = 0.0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.socket_keepalive_count = 1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.socket_keepalive_idle = 1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.socket_keepalive_interval = 1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.socket_timeout = 1.0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.tls_allowed_ciphers = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.tls_cafile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.tls_certfile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.tls_enabled = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.tls_keyfile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cache.username = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] coordination.backend_url = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.asyncio_connection = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.asyncio_slave_connection = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.backend = sqlalchemy {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.connection = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.connection_debug = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.connection_parameters = {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.connection_recycle_time = 3600 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.connection_trace = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.db_inc_retry_interval = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.db_max_retries = 20 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.db_max_retry_interval = 10 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.db_retry_interval = 1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.max_overflow = 50 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.max_pool_size = 5 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.max_retries = 10 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.mysql_wsrep_sync_wait = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.pool_timeout = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.retry_interval = 10 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.slave_connection = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.sqlite_synchronous = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.synchronous_reader = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] database.use_db_reconnect = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] profiler.connection_string = messaging:// {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] profiler.enabled = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] profiler.es_doc_type = notification {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] profiler.es_scroll_size = 10000 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] profiler.es_scroll_time = 2m {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] profiler.filter_error_trace = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] profiler.hmac_keys = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] profiler.sentinel_service_name = mymaster {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] profiler.socket_timeout = 0.1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] profiler.trace_requests = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] profiler.trace_sqlalchemy = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] profiler_jaeger.process_tags = {} {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] profiler_jaeger.service_name_prefix = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] profiler_otlp.service_name_prefix = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_policy.enforce_new_defaults = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_policy.policy_default_rule = default {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_policy.policy_file = policy.yaml {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] privsep_osbrick.group = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] privsep_osbrick.helper_command = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] privsep_osbrick.user = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cinder_sys_admin.group = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cinder_sys_admin.helper_command = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] cinder_sys_admin.user = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] service_user.auth_section = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] service_user.auth_type = password {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] service_user.cafile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] service_user.certfile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] service_user.collect_timing = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] service_user.insecure = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] service_user.keyfile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] service_user.send_service_user_token = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] service_user.split_loggers = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] service_user.timeout = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance.auth_section = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance.auth_type = password {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance.certfile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance.collect_timing = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance.insecure = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance.keyfile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance.region_name = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance.split_loggers = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] glance.timeout = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.backend_availability_zone = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.chap_password = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.chap_username = {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.disk_geometry = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.driver_client_cert = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.driver_client_cert_key = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.driver_data_namespace = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.driver_use_ssl = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.extra_capabilities = {} {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.filter_function = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.goodness_function = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack sudo[77635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.iscsi_target_flags = {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.iscsi_write_cache = on {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.iser_helper = tgtadm {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack sudo[77635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.iser_ip_address = 192.168.122.13 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.iser_port = 3260 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.lvm_share_target = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.lvm_type = auto {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.num_shell_tries = 3 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.replication_device = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.report_discard_supported = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.reserved_percentage = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.target_helper = tgtadm {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.target_ip_address = 192.168.122.13 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.target_port = 3260 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.target_protocol = iscsi {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.trace_flags = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.unique_fqdn_network = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.use_chap_auth = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.volume_backend_name = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.volume_clear = zero {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.volume_clear_ionice = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.volume_clear_size = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_reports.file_event_handler = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_reports.log_dir = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.backend_host = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.chap_password = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.chap_username = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.disk_geometry = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.driver_client_cert = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.extra_capabilities = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.filter_function = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.goodness_function = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.iser_helper = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.iser_ip_address = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.iser_port = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.060s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.lvm_share_target = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.lvm_type = auto {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.num_shell_tries = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.replication_device = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.report_discard_supported = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.reserved_percentage = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.scst_target_driver = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.storage_protocol = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.target_helper = lioadm {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.target_ip_address = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.target_port = 3260 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.trace_flags = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.use_chap_auth = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.volume_clear = zero {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.volume_clear_size = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] lvmdriver-1.volumes_dir = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.ssl = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_notifications.driver = [] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_notifications.retry = -1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] key_manager.fixed_key = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican.barbican_api_version = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican.barbican_endpoint = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican.barbican_endpoint_type = public {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican.barbican_region_name = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican.cafile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican.certfile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican.collect_timing = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican.insecure = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican.keyfile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican.number_of_retries = 60 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican.retry_delay = 1 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican.send_service_user_token = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican.split_loggers = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican.timeout = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican.verify_ssl = True {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican.verify_ssl_path = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican_service_user.auth_section = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican_service_user.auth_type = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican_service_user.cafile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican_service_user.certfile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican_service_user.collect_timing = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican_service_user.insecure = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican_service_user.keyfile = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican_service_user.split_loggers = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] barbican_service_user.timeout = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] vault.approle_role_id = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] vault.approle_secret_id = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] vault.auth_method = approle {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] vault.auth_path = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] vault.kv_mountpoint = secret {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] vault.kv_path = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] vault.kv_version = 2 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] vault.namespace = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] vault.root_token_id = **** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] vault.ssl_ca_crt_file = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] vault.timeout = 60.0 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] vault.token_file = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] vault.token_role = None {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] vault.use_ssl = False {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:18:55 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] ******************************************************************************** {{(pid=77466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 05 10:18:55 devstack sudo[77635]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:55 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.339s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:55 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:55 devstack sudo[77721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:18:55 devstack sudo[77721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:55 devstack sudo[77721]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:55 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.266s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:55 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:18:55 devstack cinder-volume[77631]: INFO cinder.brick.local_dev.lvm [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 05 10:18:55 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:55 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:55 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:56 devstack sudo[77832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:18:56 devstack sudo[77832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:56 devstack sudo[77832]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:56 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:56 devstack cinder-volume[77631]: DEBUG cinder.brick.local_dev.lvm [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77631) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 05 10:18:56 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:56 devstack sudo[77924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:18:56 devstack sudo[77924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:56 devstack sudo[77924]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:56 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.492s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:56 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:56 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:56 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:56 devstack sudo[78126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:18:56 devstack sudo[78126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:57 devstack sudo[78126]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:57 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:57 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:57 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:57 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:57 devstack sudo[78246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 05 10:18:57 devstack sudo[78246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:57 devstack sudo[78246]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:57 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.253s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:57 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:57 devstack sudo[78249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:18:57 devstack sudo[78249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:57 devstack sudo[78249]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:57 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:57 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:57 devstack sudo[78333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:18:57 devstack sudo[78333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:57 devstack sudo[78333]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:57 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:57 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:57 devstack sudo[78336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:18:57 devstack sudo[78336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:58 devstack sudo[78336]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:58 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:58 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:58 devstack sudo[78368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:18:58 devstack sudo[78368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:58 devstack sudo[78368]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:58 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.369s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:58 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:58 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:58 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:58 devstack sudo[78429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:18:58 devstack sudo[78429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:58 devstack sudo[78429]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:58 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.307s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:58 devstack cinder-volume[77631]: INFO cinder.volume.drivers.lvm [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 05 10:18:58 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:58 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:58 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:58 devstack sudo[78433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:18:58 devstack sudo[78433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:59 devstack sudo[78433]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:59 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:59 devstack cinder-volume[77631]: DEBUG cinder.volume.drivers.lvm [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Updating volume stats {{(pid=77631) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 10:18:59 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:59 devstack sudo[78437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:18:59 devstack sudo[78437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:59 devstack sudo[78437]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:59 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:59 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:59 devstack sudo[78440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:18:59 devstack sudo[78440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:18:59 devstack sudo[78440]: pam_unix(sudo:session): session closed for user root Aug 05 10:18:59 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:18:59 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:18:59 devstack sudo[78449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:18:59 devstack sudo[78449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:00 devstack sudo[78449]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:00 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:00 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:00 devstack sudo[78452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:19:00 devstack sudo[78452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:00 devstack sudo[78452]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:00 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:00 devstack cinder-volume[77631]: INFO cinder.volume.driver [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Driver hasn't implemented _init_vendor_properties() Aug 05 10:19:00 devstack cinder-volume[77631]: DEBUG cinder.volume.driver [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77631) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 05 10:19:00 devstack cinder-volume[77631]: DEBUG oslo_db.sqlalchemy.engines [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77631) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:19:00 devstack cinder-volume[77631]: DEBUG dbcounter [-] [77631] Writer thread running {{(pid=77631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 10:19:00 devstack cinder-volume[77631]: DEBUG cinder.db.api [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Building query based on filter {{(pid=77631) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 05 10:19:00 devstack cinder-volume[77631]: DEBUG cinder.image.image_utils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77631) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 05 10:19:00 devstack cinder-volume[77631]: INFO cinder.keymgr.migration [None req-fbaaa2b1-42ae-4fea-a146-8e62dc233f69 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 05 10:19:00 devstack cinder-volume[77631]: DEBUG cinder.volume.drivers.lvm [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Updating volume stats {{(pid=77631) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 10:19:00 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:00 devstack sudo[78455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:19:00 devstack sudo[78455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:00 devstack sudo[78455]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:00 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:00 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:00 devstack sudo[78459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:19:00 devstack sudo[78459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:00 devstack sudo[78459]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:00 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:00 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:00 devstack sudo[78464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:19:00 devstack sudo[78464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:01 devstack sudo[78464]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:01 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:01 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:01 devstack sudo[78467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:19:01 devstack sudo[78467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:01 devstack sudo[78467]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:01 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:01 devstack cinder-volume[77631]: DEBUG cinder.manager [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Notifying Schedulers of capabilities ... {{(pid=77631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:19:01 devstack cinder-volume[77631]: INFO cinder.volume.manager [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Driver initialization completed successfully. Aug 05 10:19:01 devstack cinder-volume[77631]: INFO cinder.manager [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Initiating service 2 cleanup Aug 05 10:19:01 devstack cinder-volume[77631]: INFO cinder.manager [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Service 2 cleanup completed. Aug 05 10:19:01 devstack cinder-volume[77631]: DEBUG cinder.service [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Creating RPC server for service cinder-volume {{(pid=77631) start /opt/stack/cinder/cinder/service.py:231}} Aug 05 10:19:01 devstack cinder-volume[77631]: DEBUG cinder.service [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77631) start /opt/stack/cinder/cinder/service.py:237}} Aug 05 10:19:01 devstack cinder-volume[77631]: INFO cinder.volume.manager [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 05 10:19:01 devstack cinder-volume[77631]: DEBUG cinder.volume.drivers.lvm [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Updating volume stats {{(pid=77631) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 10:19:01 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:01 devstack sudo[78472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:19:01 devstack sudo[78472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:01 devstack sudo[78472]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:01 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:01 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:02 devstack sudo[78475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:19:02 devstack sudo[78475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:02 devstack sudo[78475]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:02 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:02 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:02 devstack sudo[78478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:19:02 devstack sudo[78478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:02 devstack sudo[78478]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:02 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:02 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:19:02 devstack sudo[78481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:19:02 devstack sudo[78481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:19:02 devstack sudo[78481]: pam_unix(sudo:session): session closed for user root Aug 05 10:19:02 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:19:02 devstack cinder-volume[77631]: INFO cinder.volume.manager [None req-422ff331-64e1-492c-aa42-337a60e92f88 None None] Driver post RPC initialization completed successfully. Aug 05 10:19:05 devstack cinder-volume[77466]: DEBUG dbcounter [-] [77466] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:19:11 devstack cinder-volume[77631]: DEBUG dbcounter [-] [77631] Writing DB stats cinder:SELECT=3 {{(pid=77631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:19:12 devstack cinder-volume[77631]: DEBUG dbcounter [-] [77631] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:19:24 devstack cinder-volume[77631]: DEBUG oslo_service.periodic_task [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running periodic task VolumeManager._thread_info {{(pid=77631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:19:24 devstack cinder-volume[77631]: DEBUG cinder.volume.manager [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] thread count: 6 {{(pid=77631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:19:24 devstack cinder-volume[77631]: DEBUG cinder.volume.manager [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] thread info: [<_MainThread(MainThread, started 124847223259264)>, , , , , ] {{(pid=77631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:20:24 devstack cinder-volume[77631]: DEBUG oslo_service.periodic_task [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:20:24 devstack cinder-volume[77631]: DEBUG cinder.volume.drivers.lvm [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Updating volume stats {{(pid=77631) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 10:20:24 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:24 devstack sudo[81146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:20:24 devstack sudo[81146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:25 devstack sudo[81146]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:25 devstack sudo[81149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:20:25 devstack sudo[81149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:25 devstack sudo[81149]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:25 devstack sudo[81152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:20:25 devstack sudo[81152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:25 devstack sudo[81152]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:20:25 devstack sudo[81155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:20:25 devstack sudo[81155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:20:25 devstack sudo[81155]: pam_unix(sudo:session): session closed for user root Aug 05 10:20:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:20:25 devstack cinder-volume[77631]: DEBUG cinder.manager [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Notifying Schedulers of capabilities ... {{(pid=77631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:20:25 devstack cinder-volume[77631]: DEBUG oslo_service.periodic_task [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running periodic task VolumeManager._thread_info {{(pid=77631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:20:25 devstack cinder-volume[77631]: DEBUG cinder.volume.manager [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] thread count: 6 {{(pid=77631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:20:25 devstack cinder-volume[77631]: DEBUG cinder.volume.manager [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] thread info: [<_MainThread(MainThread, started 124847223259264)>, , , , , ] {{(pid=77631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:21:12 devstack cinder-volume[77631]: DEBUG dbcounter [-] [77631] Writing DB stats cinder:SELECT=1 {{(pid=77631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:21:12 devstack cinder-volume[77631]: DEBUG dbcounter [-] [77631] Writing DB stats cinder:UPDATE=1 {{(pid=77631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:21:24 devstack cinder-volume[77631]: DEBUG oslo_service.periodic_task [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:21:24 devstack cinder-volume[77631]: DEBUG cinder.volume.drivers.lvm [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Updating volume stats {{(pid=77631) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 10:21:24 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:24 devstack sudo[84139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:21:24 devstack sudo[84139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:25 devstack sudo[84139]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:25 devstack sudo[84142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:21:25 devstack sudo[84142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:25 devstack sudo[84142]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:25 devstack sudo[84145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:21:25 devstack sudo[84145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:25 devstack sudo[84145]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:21:25 devstack sudo[84148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:21:25 devstack sudo[84148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:21:25 devstack sudo[84148]: pam_unix(sudo:session): session closed for user root Aug 05 10:21:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:21:25 devstack cinder-volume[77631]: DEBUG cinder.manager [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Notifying Schedulers of capabilities ... {{(pid=77631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:21:25 devstack cinder-volume[77631]: DEBUG oslo_service.periodic_task [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running periodic task VolumeManager._thread_info {{(pid=77631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:21:25 devstack cinder-volume[77631]: DEBUG cinder.volume.manager [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] thread count: 6 {{(pid=77631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:21:25 devstack cinder-volume[77631]: DEBUG cinder.volume.manager [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] thread info: [<_MainThread(MainThread, started 124847223259264)>, , , , , ] {{(pid=77631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:22:24 devstack cinder-volume[77631]: DEBUG oslo_service.periodic_task [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:22:24 devstack cinder-volume[77631]: DEBUG cinder.volume.drivers.lvm [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Updating volume stats {{(pid=77631) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 10:22:24 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:24 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:22:24 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:25 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:25 devstack sudo[86382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:22:25 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:25 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:25 devstack sudo[86386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:22:25 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:25 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:22:25 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:22:25 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:22:25 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Aug 05 10:22:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:22:25 devstack cinder-volume[77631]: DEBUG cinder.manager [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Notifying Schedulers of capabilities ... {{(pid=77631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:22:25 devstack cinder-volume[77631]: DEBUG oslo_service.periodic_task [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running periodic task VolumeManager._thread_info {{(pid=77631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:22:25 devstack cinder-volume[77631]: DEBUG cinder.volume.manager [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] thread count: 6 {{(pid=77631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:22:25 devstack cinder-volume[77631]: DEBUG cinder.volume.manager [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] thread info: [<_MainThread(MainThread, started 124847223259264)>, , , , , ] {{(pid=77631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:23:12 devstack cinder-volume[77631]: DEBUG dbcounter [-] [77631] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:23:24 devstack cinder-volume[77631]: DEBUG oslo_service.periodic_task [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:23:24 devstack cinder-volume[77631]: DEBUG cinder.volume.drivers.lvm [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Updating volume stats {{(pid=77631) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 10:23:24 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:24 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 10:23:24 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:25 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:25 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:23:25 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:25 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:25 devstack sudo[87464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 10:23:25 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:25 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:25 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:25 devstack sudo[87467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 10:23:25 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:26 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:26 devstack cinder-volume[77631]: DEBUG oslo_concurrency.processutils [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:26 devstack cinder-volume[77631]: DEBUG cinder.manager [None req-2d3ce7ae-375d-4cae-987a-34a2710577cb None None] Notifying Schedulers of capabilities ... {{(pid=77631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:32 devstack cinder-volume[77466]: INFO oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Caught SIGTERM, stopping children Aug 05 10:23:32 devstack cinder-volume[77466]: DEBUG oslo_concurrency.lockutils [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Acquiring lock "singleton_lock" {{(pid=77466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 10:23:32 devstack cinder-volume[77466]: DEBUG oslo_concurrency.lockutils [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Acquired lock "singleton_lock" {{(pid=77466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 10:23:32 devstack cinder-volume[77466]: DEBUG oslo_concurrency.lockutils [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Releasing lock "singleton_lock" {{(pid=77466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 10:23:32 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Stop services. {{(pid=77466) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 05 10:23:32 devstack cinder-volume[77466]: DEBUG oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Killing children. {{(pid=77466) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 05 10:23:32 devstack cinder-volume[77466]: INFO oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Waiting on 1 children to exit Aug 05 10:23:36 devstack cinder-volume[77631]: DEBUG oslo_concurrency.lockutils [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Acquiring lock "singleton_lock" {{(pid=77631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 10:23:36 devstack cinder-volume[77631]: DEBUG oslo_concurrency.lockutils [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Acquired lock "singleton_lock" {{(pid=77631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 10:23:36 devstack cinder-volume[77631]: DEBUG oslo_concurrency.lockutils [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Releasing lock "singleton_lock" {{(pid=77631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 10:23:36 devstack cinder-volume[77631]: WARNING amqp [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 10:23:36 devstack cinder-volume[77631]: WARNING amqp [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 10:23:36 devstack cinder-volume[77466]: INFO oslo_service.backend._eventlet.service [None req-864e70da-68f7-4432-9cca-4d5558d52b05 None None] Child 77631 exited with status 0 Aug 05 10:23:37 devstack cinder-volume[87770]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 05 10:23:37 devstack cinder-volume[87770]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 10:23:37 devstack cinder-volume[87770]: we strongly recommend against using it for new projects. Aug 05 10:23:37 devstack cinder-volume[87770]: If you are already using Eventlet, we recommend migrating to a different Aug 05 10:23:37 devstack cinder-volume[87770]: framework. For more detail see Aug 05 10:23:37 devstack cinder-volume[87770]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 10:23:37 devstack cinder-volume[87770]: import eventlet # noqa Aug 05 10:23:39 devstack cinder-volume[87770]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 10:23:39 devstack cinder-volume[87770]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 10:23:39 devstack cinder-volume[87770]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 10:23:39 devstack cinder-volume[87770]: INFO dbcounter [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Registered counter for database cinder Aug 05 10:23:39 devstack cinder-volume[87770]: DEBUG oslo_db.sqlalchemy.engines [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87770) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG dbcounter [-] [87770] Writer thread running {{(pid=87770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 10:23:40 devstack cinder-volume[87770]: INFO cinder.rpc [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 05 10:23:40 devstack cinder-volume[87770]: INFO cinder.rpc [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_db.sqlalchemy.engines [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87770) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:23:40 devstack cinder-volume[87770]: INFO cinder.volume.manager [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Determined volume DB was empty at startup. Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG cinder.volume.manager [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87770) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 05 10:23:40 devstack cinder-volume[87770]: INFO cinder.volume.manager [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 05 10:23:40 devstack cinder-volume[87770]: WARNING stevedore.named [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 10:23:40 devstack cinder-volume[87770]: WARNING castellan.key_manager [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 10:23:40 devstack cinder-volume[87770]: WARNING cinder.keymgr.conf_key_mgr [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 10:23:40 devstack cinder-volume[87770]: INFO cinder.volume.manager [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_db.sqlalchemy.engines [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87770) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:23:40 devstack cinder-volume[87770]: INFO oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Starting 1 workers Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Started child 87986 {{(pid=87770) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Full set of CONF: {{(pid=87770) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] ******************************************************************************** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Configuration options gathered from: {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] ================================================================================ {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 05 10:23:40 devstack cinder-volume[87986]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] allow_availability_zone_fallback = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] allow_compression_on_image_upload = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] allowed_direct_url_schemes = [] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] api_rate_limit = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] auth_strategy = keystone {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_availability_zone = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_host = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_name = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_stats_polling_interval = 60 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backup_api_class = cinder.backup.api.API {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backup_name_template = backup-%s {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backup_use_same_host = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backup_use_temp_snapshot = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] chap_password = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] chap_username = {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cinder_internal_tenant_project_id = 732db3173e8243b8bde170f8823fdedb {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cinder_internal_tenant_user_id = 98e715250139425ba44b5a4cc0cbf18d {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cluster = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] compression_format = gzip {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] compute_api_class = cinder.compute.nova.API {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] config_dir = [] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] config_source = [] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] control_exchange = openstack {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] debug = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] default_availability_zone = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] default_group_type = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] default_volume_type = QuobyteHD {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] disk_geometry = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] driver_client_cert = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] driver_client_cert_key = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] driver_data_namespace = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] driver_ssl_cert_path = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] driver_ssl_cert_verify = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] driver_use_ssl = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] enable_new_services = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] enable_unsupported_driver = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] enabled_backends = ['QuobyteHD'] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] enforce_multipath_for_image_xfer = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] filter_function = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance_api_insecure = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance_api_servers = ['http://192.168.122.13/image'] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance_api_ssl_compression = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance_ca_certificates_file = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87986]: INFO cinder.volume.manager [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Starting volume driver QuobyteDriver (1.2) Aug 05 10:23:40 devstack cinder-volume[87986]: DEBUG cinder.volume.drivers.remotefs [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87986) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance_catalog_info = image:glance:publicURL {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance_certfile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance_keyfile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance_num_retries = 3 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance_request_timeout = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] goodness_function = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] graceful_shutdown_timeout = 5 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] group_api_class = cinder.group.api.API {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] host = devstack {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] image_compress_on_upload = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] image_conversion_address_space_limit = 1 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] image_conversion_cpu_limit = 60 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] image_conversion_disable = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] image_upload_use_cinder_backend = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] image_upload_use_internal_tenant = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] image_volume_cache_enabled = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] image_volume_cache_max_count = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] image_volume_cache_max_size_gb = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] init_host_max_objects_retrieval = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] instance_format = [instance: %(uuid)s] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] iscsi_target_flags = {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] iscsi_write_cache = on {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] iser_helper = tgtadm {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] iser_ip_address = 192.168.122.13 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] iser_port = 3260 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] log_color = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] log_config_append = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] log_dir = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] log_file = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] log_options = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] log_rotate_interval = 1 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] log_rotate_interval_type = days {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] log_rotation_type = none {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] max_age = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] max_logfile_count = 30 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] max_logfile_size_mb = 200 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] max_over_subscription_ratio = 20.0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] message_reap_interval = 86400 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] message_ttl = 2592000 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] migration_create_volume_timeout_secs = 300 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] monkey_patch = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] monkey_patch_modules = [] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] my_ip = 192.168.122.13 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] no_snapshot_gb_quota = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] num_iser_scan_tries = 3 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] num_shell_tries = 3 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] num_volume_device_scan_tries = 3 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] nvmeof_conn_info_version = 1 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] nvmet_ns_id = 10 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] nvmet_port_id = 1 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] osapi_max_limit = 1000 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] osapi_volume_ext_list = [] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87986]: DEBUG cinder.volume.drivers.quobyte [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87986) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 05 10:23:40 devstack cinder-volume[87986]: WARNING cinder.volume.drivers.quobyte [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 05 10:23:40 devstack cinder-volume[87986]: WARNING cinder.volume.drivers.quobyte [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 05 10:23:40 devstack cinder-volume[87986]: DEBUG oslo_concurrency.processutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Running cmd (subprocess): mount.quobyte {{(pid=87986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] osapi_volume_listen_port = 8776 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] osapi_volume_use_ssl = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] osapi_volume_workers = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] per_volume_size_limit = -1 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] periodic_fuzzy_delay = 60 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] periodic_interval = 60 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] public_endpoint = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] publish_errors = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] quota_backup_gigabytes = 1000 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] quota_backups = 10 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] quota_gigabytes = 1000 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] quota_groups = 10 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] quota_snapshots = 10 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] quota_volumes = 10 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] rate_limit_burst = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] rate_limit_except_level = CRITICAL {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] rate_limit_interval = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] reinit_driver_count = 3 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] replication_device = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] report_discard_supported = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] report_interval = 120 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] reservation_clean_interval = 86400 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] reservation_expire = 86400 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] reserved_image_namespaces = [] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] reserved_percentage = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] rpc_response_timeout = 120 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] run_external_periodic_tasks = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] scst_target_driver = iscsi {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] scst_target_iqn_name = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] service_down_time = 720 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] shell_completion = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] snapshot_name_template = snapshot-%s {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] split_loggers = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] state_path = /opt/stack/data/cinder {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] storage_availability_zone = nova {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] storage_protocol = iSCSI {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] syslog_log_facility = LOG_USER {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] target_helper = lioadm {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] target_ip_address = 192.168.122.13 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] target_port = 3260 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] target_protocol = iscsi {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] target_secondary_ip_addresses = [] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] trace_flags = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] transport_url = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] until_refresh = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] use_chap_auth = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] use_default_quota_class = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] use_journal = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] use_json = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] use_multipath_for_image_xfer = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] use_stderr = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] use_syslog = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] verify_glance_signatures = enabled {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] volume_api_class = cinder.volume.api.API {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] volume_backend_name = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] volume_clear = zero {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] volume_clear_ionice = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] volume_clear_size = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] volume_copy_bps_limit = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] volume_dd_blocksize = 1M {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] volume_name_template = volume-%s {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] volume_service_inithost_offload = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] volume_usage_audit_period = month {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] zoning_mode = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_concurrency.disable_process_locking = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.auth_section = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.auth_type = password {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.auth_version = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.cache = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.certfile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack quobyte-client[87991]: Reading configuration file: /etc/quobyte/client.cfg Aug 05 10:23:40 devstack quobyte-client[87991]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.include_service_catalog = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.insecure = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.interface = public {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.keyfile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87986]: DEBUG oslo_concurrency.processutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] CMD "mount.quobyte" returned: 1 in 0.075s {{(pid=87986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:40 devstack cinder-volume[87986]: DEBUG oslo_concurrency.lockutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87986) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.memcache_password = {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87986]: DEBUG oslo_concurrency.lockutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87986) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:40 devstack cinder-volume[87986]: DEBUG cinder.volume.drivers.quobyte [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=87986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87986]: INFO cinder.volume.drivers.quobyte [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 ... Aug 05 10:23:40 devstack cinder-volume[87986]: DEBUG oslo_concurrency.processutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd -c /etc/quobyte/client-cinder.cfg {{(pid=87986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.memcache_username = {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.region_name = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.service_type = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.13/identity {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.backend = dogpile.cache.null {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.backend_argument = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.backend_expiration_time = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.config_prefix = cache.oslo {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.debug_cache_backend = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.enable_retry_client = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.enable_socket_keepalive = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.enabled = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.expiration_time = 600 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.hashclient_retry_attempts = 2 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.memcache_dead_retry = 300 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.memcache_pool_maxsize = 10 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.memcache_sasl_enabled = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.password = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.proxies = [] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.redis_db = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd -c /etc/quobyte/client-cinder.cfg Aug 05 10:23:40 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.redis_server = localhost:6379 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.retry_attempts = 2 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.retry_delay = 0.0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.socket_keepalive_count = 1 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.socket_keepalive_idle = 1 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.socket_keepalive_interval = 1 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.socket_timeout = 1.0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.tls_allowed_ciphers = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.tls_cafile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.tls_certfile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.tls_enabled = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.tls_keyfile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cache.username = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] coordination.backend_url = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.asyncio_connection = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.asyncio_slave_connection = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.backend = sqlalchemy {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.connection = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.connection_debug = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.connection_parameters = {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.connection_recycle_time = 3600 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.connection_trace = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.db_inc_retry_interval = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.db_max_retries = 20 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.db_max_retry_interval = 10 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.db_retry_interval = 1 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.max_overflow = 50 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.max_pool_size = 5 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.max_retries = 10 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.mysql_wsrep_sync_wait = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.pool_timeout = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.retry_interval = 10 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.slave_connection = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.sqlite_synchronous = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.synchronous_reader = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] database.use_db_reconnect = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] profiler.connection_string = messaging:// {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] profiler.enabled = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] profiler.es_doc_type = notification {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] profiler.es_scroll_size = 10000 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] profiler.es_scroll_time = 2m {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] profiler.filter_error_trace = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] profiler.hmac_keys = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] profiler.sentinel_service_name = mymaster {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] profiler.socket_timeout = 0.1 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] profiler.trace_requests = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] profiler.trace_sqlalchemy = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] profiler_jaeger.process_tags = {} {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] profiler_jaeger.service_name_prefix = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] profiler_otlp.service_name_prefix = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_policy.enforce_new_defaults = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_policy.policy_default_rule = default {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_policy.policy_file = policy.yaml {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] privsep_osbrick.group = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] privsep_osbrick.helper_command = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] privsep_osbrick.user = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cinder_sys_admin.group = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cinder_sys_admin.helper_command = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] cinder_sys_admin.user = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] service_user.auth_section = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] service_user.auth_type = password {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] service_user.cafile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] service_user.certfile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] service_user.collect_timing = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] service_user.insecure = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] service_user.keyfile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] service_user.send_service_user_token = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] service_user.split_loggers = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] service_user.timeout = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance.auth_section = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance.auth_type = password {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance.certfile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance.collect_timing = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance.insecure = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance.keyfile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance.region_name = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance.split_loggers = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] glance.timeout = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.backend_availability_zone = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.chap_password = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.chap_username = {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.disk_geometry = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.driver_client_cert = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.driver_client_cert_key = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.driver_data_namespace = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.driver_use_ssl = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.extra_capabilities = {} {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.filter_function = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.goodness_function = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.iscsi_target_flags = {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.iscsi_write_cache = on {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.iser_helper = tgtadm {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.iser_ip_address = 192.168.122.13 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.iser_port = 3260 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:40 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.nas_host = {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.nas_login = admin {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.nas_mount_options = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.nas_password = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.nas_private_key = {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.nas_share_path = {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.num_shell_tries = 3 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.quobyte_volume_url = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.replication_device = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.report_discard_supported = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.reserved_percentage = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.target_helper = tgtadm {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.target_ip_address = 192.168.122.13 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.target_port = 3260 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.target_protocol = iscsi {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.trace_flags = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.unique_fqdn_network = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.use_chap_auth = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.volume_backend_name = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.volume_clear = zero {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.volume_clear_ionice = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.volume_clear_size = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_reports.file_event_handler = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_reports.log_dir = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.backend_availability_zone = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.backend_host = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.chap_password = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.chap_username = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.chiscsi_conf = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.disk_geometry = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.driver_client_cert = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.driver_data_namespace = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.driver_use_ssl = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.extra_capabilities = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.filter_function = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.goodness_function = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.iser_helper = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.iser_ip_address = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.iser_port = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.iser_target_prefix = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.nas_host = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.nas_login = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.nas_mount_options = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.nas_password = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.nas_private_key = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.nas_share_path = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.nas_ssh_port = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.num_shell_tries = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.nvmet_port_id = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.replication_device = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.report_discard_supported = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.reserved_percentage = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.scst_target_driver = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.storage_protocol = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.target_helper = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.target_ip_address = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.target_port = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.target_prefix = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.target_protocol = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.trace_flags = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.use_chap_auth = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.volume_clear = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.volume_clear_size = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] QuobyteHD.volumes_dir = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.ssl = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_notifications.driver = [] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_notifications.retry = -1 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] key_manager.fixed_key = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican.barbican_api_version = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican.barbican_endpoint = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican.barbican_endpoint_type = public {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican.barbican_region_name = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican.cafile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican.certfile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican.collect_timing = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican.insecure = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican.keyfile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican.number_of_retries = 60 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican.retry_delay = 1 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican.send_service_user_token = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican.split_loggers = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican.timeout = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican.verify_ssl = True {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican.verify_ssl_path = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican_service_user.auth_section = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican_service_user.auth_type = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican_service_user.cafile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican_service_user.certfile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican_service_user.collect_timing = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican_service_user.insecure = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican_service_user.keyfile = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican_service_user.split_loggers = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] barbican_service_user.timeout = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] vault.approle_role_id = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] vault.approle_secret_id = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] vault.auth_method = approle {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] vault.auth_path = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] vault.kv_mountpoint = secret {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] vault.kv_path = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] vault.kv_version = 2 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] vault.namespace = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] vault.root_token_id = **** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] vault.ssl_ca_crt_file = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] vault.timeout = 60.0 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] vault.token_file = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] vault.token_role = None {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] vault.use_ssl = False {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:41 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] ******************************************************************************** {{(pid=87770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 05 10:23:41 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:41 devstack cinder-volume[87986]: DEBUG oslo_concurrency.processutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.404s {{(pid=87986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:41 devstack cinder-volume[87986]: INFO cinder.volume.drivers.quobyte [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 succeeded Aug 05 10:23:41 devstack cinder-volume[87986]: DEBUG cinder.volume.drivers.quobyte [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=87986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:41 devstack cinder-volume[87986]: DEBUG oslo_concurrency.lockutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.415s {{(pid=87986) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:41 devstack cinder-volume[87986]: DEBUG oslo_concurrency.processutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=87986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:41 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:23:41 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:41 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:41 devstack cinder-volume[87986]: DEBUG oslo_concurrency.processutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.340s {{(pid=87986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:41 devstack cinder-volume[87986]: INFO cinder.volume.driver [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Driver hasn't implemented _init_vendor_properties() Aug 05 10:23:41 devstack cinder-volume[87986]: DEBUG cinder.volume.driver [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6894226074219, 'free_capacity_gb': 1775.6894226074219, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87986) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 05 10:23:41 devstack cinder-volume[87986]: DEBUG oslo_db.sqlalchemy.engines [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87986) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:23:41 devstack cinder-volume[87986]: DEBUG dbcounter [-] [87986] Writer thread running {{(pid=87986) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 10:23:41 devstack cinder-volume[87986]: DEBUG cinder.db.api [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Building query based on filter {{(pid=87986) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 05 10:23:41 devstack cinder-volume[87986]: DEBUG cinder.image.image_utils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87986) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 05 10:23:41 devstack cinder-volume[87986]: INFO cinder.keymgr.migration [None req-add761f9-f9dd-4524-9fad-ff2a3f4b7e46 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 05 10:23:41 devstack cinder-volume[87986]: DEBUG oslo_concurrency.lockutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87986) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:41 devstack cinder-volume[87986]: DEBUG oslo_concurrency.lockutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87986) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:41 devstack cinder-volume[87986]: DEBUG cinder.volume.drivers.quobyte [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=87986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:41 devstack cinder-volume[87986]: DEBUG cinder.volume.drivers.quobyte [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=87986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:41 devstack cinder-volume[87986]: DEBUG oslo_concurrency.lockutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87986) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:41 devstack cinder-volume[87986]: DEBUG oslo_concurrency.processutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=87986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:41 devstack sudo[88077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:23:41 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:42 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:42 devstack cinder-volume[87986]: DEBUG oslo_concurrency.processutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.283s {{(pid=87986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:42 devstack cinder-volume[87986]: DEBUG cinder.manager [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Notifying Schedulers of capabilities ... {{(pid=87986) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:42 devstack cinder-volume[87986]: INFO cinder.volume.manager [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Driver initialization completed successfully. Aug 05 10:23:42 devstack cinder-volume[87986]: INFO cinder.manager [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Initiating service 3 cleanup Aug 05 10:23:42 devstack cinder-volume[87986]: INFO cinder.manager [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Service 3 cleanup completed. Aug 05 10:23:42 devstack cinder-volume[87986]: DEBUG cinder.service [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Creating RPC server for service cinder-volume {{(pid=87986) start /opt/stack/cinder/cinder/service.py:231}} Aug 05 10:23:42 devstack cinder-volume[87986]: DEBUG cinder.service [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87986) start /opt/stack/cinder/cinder/service.py:237}} Aug 05 10:23:42 devstack cinder-volume[87986]: INFO cinder.volume.manager [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 05 10:23:42 devstack cinder-volume[87986]: DEBUG oslo_concurrency.lockutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87986) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:42 devstack cinder-volume[87986]: DEBUG oslo_concurrency.lockutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87986) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:42 devstack cinder-volume[87986]: DEBUG cinder.volume.drivers.quobyte [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=87986) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:42 devstack cinder-volume[87986]: DEBUG cinder.volume.drivers.quobyte [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=87986) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:42 devstack cinder-volume[87986]: DEBUG oslo_concurrency.lockutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87986) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:42 devstack cinder-volume[87986]: DEBUG oslo_concurrency.processutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=87986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:42 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:23:42 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:42 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:42 devstack cinder-volume[87986]: DEBUG oslo_concurrency.processutils [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.324s {{(pid=87986) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:42 devstack cinder-volume[87986]: INFO cinder.volume.manager [None req-b4f8083b-d56f-4521-b614-d2bcc5bfc1bd None None] Driver post RPC initialization completed successfully. Aug 05 10:23:47 devstack cinder-volume[87770]: INFO oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Caught SIGTERM, stopping children Aug 05 10:23:47 devstack cinder-volume[87770]: DEBUG oslo_concurrency.lockutils [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Acquiring lock "singleton_lock" {{(pid=87770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 10:23:47 devstack cinder-volume[87770]: DEBUG oslo_concurrency.lockutils [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Acquired lock "singleton_lock" {{(pid=87770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 10:23:47 devstack cinder-volume[87770]: DEBUG oslo_concurrency.lockutils [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Releasing lock "singleton_lock" {{(pid=87770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 10:23:47 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Stop services. {{(pid=87770) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 05 10:23:47 devstack cinder-volume[87770]: DEBUG oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Killing children. {{(pid=87770) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 05 10:23:47 devstack cinder-volume[87770]: INFO oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Waiting on 1 children to exit Aug 05 10:23:50 devstack cinder-volume[87986]: DEBUG oslo_concurrency.lockutils [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Acquiring lock "singleton_lock" {{(pid=87986) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 10:23:50 devstack cinder-volume[87986]: DEBUG oslo_concurrency.lockutils [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Acquired lock "singleton_lock" {{(pid=87986) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 10:23:50 devstack cinder-volume[87986]: DEBUG oslo_concurrency.lockutils [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Releasing lock "singleton_lock" {{(pid=87986) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 10:23:50 devstack cinder-volume[87986]: WARNING amqp [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 10:23:50 devstack cinder-volume[87986]: WARNING amqp [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 10:23:50 devstack cinder-volume[87770]: INFO oslo_service.backend._eventlet.service [None req-3daf8259-d8b5-4603-aa5f-c94ee6ae91b7 None None] Child 87986 exited with status 0 Aug 05 10:23:51 devstack cinder-volume[88432]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 05 10:23:51 devstack cinder-volume[88432]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 10:23:51 devstack cinder-volume[88432]: we strongly recommend against using it for new projects. Aug 05 10:23:51 devstack cinder-volume[88432]: If you are already using Eventlet, we recommend migrating to a different Aug 05 10:23:51 devstack cinder-volume[88432]: framework. For more detail see Aug 05 10:23:51 devstack cinder-volume[88432]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 10:23:51 devstack cinder-volume[88432]: import eventlet # noqa Aug 05 10:23:53 devstack cinder-volume[88432]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88432) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 10:23:53 devstack cinder-volume[88432]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88432) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 10:23:53 devstack cinder-volume[88432]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88432) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 10:23:54 devstack cinder-volume[88432]: INFO dbcounter [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] Registered counter for database cinder Aug 05 10:23:54 devstack cinder-volume[88432]: DEBUG oslo_db.sqlalchemy.engines [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88432) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG dbcounter [-] [88432] Writer thread running {{(pid=88432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 10:23:55 devstack cinder-volume[88432]: INFO cinder.rpc [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 05 10:23:55 devstack cinder-volume[88432]: INFO cinder.rpc [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_db.sqlalchemy.engines [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88432) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:23:55 devstack cinder-volume[88432]: INFO cinder.volume.manager [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] Determined volume DB was empty at startup. Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG cinder.volume.manager [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88432) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 05 10:23:55 devstack cinder-volume[88432]: WARNING stevedore.named [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 10:23:55 devstack cinder-volume[88432]: WARNING castellan.key_manager [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 10:23:55 devstack cinder-volume[88432]: WARNING cinder.keymgr.conf_key_mgr [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 10:23:55 devstack cinder-volume[88432]: INFO cinder.volume.manager [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_db.sqlalchemy.engines [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88432) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:23:55 devstack cinder-volume[88432]: INFO oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] Starting 1 workers Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] Started child 88736 {{(pid=88432) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] Full set of CONF: {{(pid=88432) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] ******************************************************************************** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] Configuration options gathered from: {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] ================================================================================ {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] allow_availability_zone_fallback = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] allow_compression_on_image_upload = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] allowed_direct_url_schemes = [] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] api_rate_limit = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] auth_strategy = keystone {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_availability_zone = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_host = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88736]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_name = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_stats_polling_interval = 60 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backup_api_class = cinder.backup.api.API {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backup_name_template = backup-%s {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backup_use_same_host = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backup_use_temp_snapshot = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] chap_password = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] chap_username = {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cinder_internal_tenant_project_id = 732db3173e8243b8bde170f8823fdedb {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cinder_internal_tenant_user_id = 98e715250139425ba44b5a4cc0cbf18d {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cluster = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] compression_format = gzip {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] compute_api_class = cinder.compute.nova.API {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] config_dir = [] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] config_source = [] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] control_exchange = openstack {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] debug = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] default_availability_zone = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] default_group_type = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] default_volume_type = QuobyteHD {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] disk_geometry = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] driver_client_cert = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] driver_client_cert_key = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] driver_data_namespace = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] driver_ssl_cert_path = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] driver_ssl_cert_verify = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] driver_use_ssl = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] enable_new_services = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] enable_unsupported_driver = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] enabled_backends = ['QuobyteHD'] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] enforce_multipath_for_image_xfer = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] filter_function = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance_api_insecure = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance_api_servers = ['http://192.168.122.13/image'] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance_api_ssl_compression = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance_ca_certificates_file = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance_catalog_info = image:glance:publicURL {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance_certfile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance_keyfile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance_num_retries = 3 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance_request_timeout = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] goodness_function = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] graceful_shutdown_timeout = 5 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] group_api_class = cinder.group.api.API {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] host = devstack {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] image_compress_on_upload = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] image_conversion_address_space_limit = 1 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] image_conversion_cpu_limit = 60 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] image_conversion_disable = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] image_upload_use_cinder_backend = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] image_upload_use_internal_tenant = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] image_volume_cache_enabled = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] image_volume_cache_max_count = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] image_volume_cache_max_size_gb = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] init_host_max_objects_retrieval = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] instance_format = [instance: %(uuid)s] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] iscsi_target_flags = {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] iscsi_write_cache = on {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] iser_helper = tgtadm {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] iser_ip_address = 192.168.122.13 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] iser_port = 3260 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] log_color = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] log_config_append = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] log_dir = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] log_file = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] log_options = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] log_rotate_interval = 1 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] log_rotate_interval_type = days {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] log_rotation_type = none {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] max_age = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] max_logfile_count = 30 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] max_logfile_size_mb = 200 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] max_over_subscription_ratio = 20.0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] message_reap_interval = 86400 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] message_ttl = 2592000 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] migration_create_volume_timeout_secs = 300 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] monkey_patch = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] monkey_patch_modules = [] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] my_ip = 192.168.122.13 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] no_snapshot_gb_quota = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] num_iser_scan_tries = 3 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] num_shell_tries = 3 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] num_volume_device_scan_tries = 3 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] nvmeof_conn_info_version = 1 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] nvmet_ns_id = 10 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] nvmet_port_id = 1 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] osapi_max_limit = 1000 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] osapi_volume_ext_list = [] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] osapi_volume_listen_port = 8776 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] osapi_volume_use_ssl = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] osapi_volume_workers = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] per_volume_size_limit = -1 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] periodic_fuzzy_delay = 60 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] periodic_interval = 60 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] public_endpoint = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] publish_errors = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] quota_backup_gigabytes = 1000 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] quota_backups = 10 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] quota_gigabytes = 1000 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] quota_groups = 10 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] quota_snapshots = 10 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] quota_volumes = 10 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] rate_limit_burst = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] rate_limit_except_level = CRITICAL {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] rate_limit_interval = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] reinit_driver_count = 3 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Starting volume driver QuobyteDriver (1.2) Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] replication_device = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] report_discard_supported = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] report_interval = 120 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88736) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] reservation_clean_interval = 86400 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] reservation_expire = 86400 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] reserved_image_namespaces = [] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] reserved_percentage = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] rpc_response_timeout = 120 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] run_external_periodic_tasks = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] scst_target_driver = iscsi {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] scst_target_iqn_name = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] service_down_time = 720 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] shell_completion = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] snapshot_name_template = snapshot-%s {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] split_loggers = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] state_path = /opt/stack/data/cinder {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] storage_availability_zone = nova {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] storage_protocol = iSCSI {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] syslog_log_facility = LOG_USER {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] target_helper = lioadm {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] target_ip_address = 192.168.122.13 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] target_port = 3260 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] target_protocol = iscsi {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] target_secondary_ip_addresses = [] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] trace_flags = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] transport_url = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] until_refresh = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] use_chap_auth = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] use_default_quota_class = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] use_journal = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] use_json = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] use_multipath_for_image_xfer = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] use_stderr = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] use_syslog = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] verify_glance_signatures = enabled {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] volume_api_class = cinder.volume.api.API {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] volume_backend_name = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] volume_clear = zero {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] volume_clear_ionice = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] volume_clear_size = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] volume_copy_bps_limit = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] volume_dd_blocksize = 1M {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] volume_name_template = volume-%s {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] volume_service_inithost_offload = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] volume_usage_audit_period = month {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] zoning_mode = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_concurrency.disable_process_locking = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.auth_section = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.auth_type = password {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.auth_version = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.cache = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.certfile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.include_service_catalog = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.insecure = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.interface = public {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.keyfile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.memcache_password = {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.memcache_username = {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.region_name = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.service_type = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.13/identity {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.backend = dogpile.cache.null {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.backend_argument = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.backend_expiration_time = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.config_prefix = cache.oslo {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.debug_cache_backend = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.enable_retry_client = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.enable_socket_keepalive = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.enabled = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.expiration_time = 600 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.hashclient_retry_attempts = 2 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.memcache_dead_retry = 300 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.memcache_pool_maxsize = 10 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.memcache_sasl_enabled = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.password = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.proxies = [] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.redis_db = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.redis_server = localhost:6379 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.retry_attempts = 2 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.retry_delay = 0.0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.socket_keepalive_count = 1 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.socket_keepalive_idle = 1 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.socket_keepalive_interval = 1 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.socket_timeout = 1.0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.tls_allowed_ciphers = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.tls_cafile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.tls_certfile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.tls_enabled = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.tls_keyfile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cache.username = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] coordination.backend_url = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.asyncio_connection = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.asyncio_slave_connection = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.backend = sqlalchemy {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.connection = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.connection_debug = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.connection_parameters = {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.connection_recycle_time = 3600 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.connection_trace = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.db_inc_retry_interval = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.db_max_retries = 20 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.db_max_retry_interval = 10 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.db_retry_interval = 1 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.max_overflow = 50 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.max_pool_size = 5 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.max_retries = 10 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.mysql_wsrep_sync_wait = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.pool_timeout = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.retry_interval = 10 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.slave_connection = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.sqlite_synchronous = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.synchronous_reader = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] database.use_db_reconnect = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] profiler.connection_string = messaging:// {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] profiler.enabled = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] profiler.es_doc_type = notification {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] profiler.es_scroll_size = 10000 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] profiler.es_scroll_time = 2m {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] profiler.filter_error_trace = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] profiler.hmac_keys = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] profiler.sentinel_service_name = mymaster {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] profiler.socket_timeout = 0.1 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] profiler.trace_requests = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] profiler.trace_sqlalchemy = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] profiler_jaeger.process_tags = {} {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] profiler_jaeger.service_name_prefix = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] profiler_otlp.service_name_prefix = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_policy.enforce_new_defaults = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_policy.policy_default_rule = default {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_policy.policy_file = policy.yaml {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] privsep_osbrick.group = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] privsep_osbrick.helper_command = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] privsep_osbrick.user = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cinder_sys_admin.group = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cinder_sys_admin.helper_command = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] cinder_sys_admin.user = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] service_user.auth_section = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] service_user.auth_type = password {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] service_user.cafile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] service_user.certfile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] service_user.collect_timing = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] service_user.insecure = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88736) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 05 10:23:55 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.quobyte [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] service_user.keyfile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] service_user.send_service_user_token = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] service_user.split_loggers = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] service_user.timeout = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance.auth_section = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance.auth_type = password {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance.certfile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance.collect_timing = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance.insecure = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance.keyfile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.quobyte [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance.region_name = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance.split_loggers = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] glance.timeout = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.backend_availability_zone = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.chap_password = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.chap_username = {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.disk_geometry = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Running cmd (subprocess): mount.quobyte {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.driver_client_cert = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.driver_client_cert_key = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.driver_data_namespace = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.driver_use_ssl = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.extra_capabilities = {} {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.filter_function = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.goodness_function = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.iscsi_target_flags = {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.iscsi_write_cache = on {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.iser_helper = tgtadm {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.iser_ip_address = 192.168.122.13 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.iser_port = 3260 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.nas_host = {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.nas_login = admin {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.nas_mount_options = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.nas_password = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.nas_private_key = {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.nas_share_path = {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.num_shell_tries = 3 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.quobyte_volume_url = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.replication_device = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.report_discard_supported = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.reserved_percentage = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.target_helper = tgtadm {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.target_ip_address = 192.168.122.13 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.target_port = 3260 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.target_protocol = iscsi {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.trace_flags = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.unique_fqdn_network = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.use_chap_auth = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.volume_backend_name = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.volume_clear = zero {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.volume_clear_ionice = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.volume_clear_size = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_reports.file_event_handler = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_reports.log_dir = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.backend_availability_zone = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.backend_host = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.chap_password = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.chap_username = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.chiscsi_conf = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.disk_geometry = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.driver_client_cert = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.driver_data_namespace = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.driver_use_ssl = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.extra_capabilities = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.filter_function = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.goodness_function = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.iser_helper = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.iser_ip_address = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.iser_port = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.iser_target_prefix = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.nas_host = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.nas_login = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.nas_mount_options = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.nas_password = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.nas_private_key = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.nas_share_path = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.nas_ssh_port = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.num_shell_tries = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.nvmet_port_id = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.replication_device = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.report_discard_supported = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.reserved_percentage = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.scst_target_driver = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.storage_protocol = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.target_helper = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.target_ip_address = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.target_port = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.target_prefix = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.target_protocol = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.trace_flags = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.use_chap_auth = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.volume_clear = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.volume_clear_size = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] QuobyteHD.volumes_dir = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.ssl = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_notifications.driver = [] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_notifications.retry = -1 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] key_manager.fixed_key = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican.barbican_api_version = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican.barbican_endpoint = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican.barbican_endpoint_type = public {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican.barbican_region_name = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican.cafile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican.certfile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican.collect_timing = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican.insecure = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican.keyfile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican.number_of_retries = 60 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican.retry_delay = 1 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican.send_service_user_token = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican.split_loggers = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican.timeout = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican.verify_ssl = True {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican.verify_ssl_path = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican_service_user.auth_section = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican_service_user.auth_type = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican_service_user.cafile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican_service_user.certfile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican_service_user.collect_timing = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican_service_user.insecure = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican_service_user.keyfile = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican_service_user.split_loggers = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] barbican_service_user.timeout = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] vault.approle_role_id = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] vault.approle_secret_id = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] vault.auth_method = approle {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] vault.auth_path = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] vault.kv_mountpoint = secret {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] vault.kv_path = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] vault.kv_version = 2 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] vault.namespace = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] vault.root_token_id = **** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] vault.ssl_ca_crt_file = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] vault.timeout = 60.0 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] vault.token_file = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] vault.token_role = None {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] vault.use_ssl = False {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 10:23:55 devstack cinder-volume[88432]: DEBUG oslo_service.backend._eventlet.service [None req-d5539f0c-3689-4b65-a283-ae6aeba19fb0 None None] ******************************************************************************** {{(pid=88432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 05 10:23:56 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.253s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:56 devstack cinder-volume[88736]: INFO cinder.volume.driver [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Driver hasn't implemented _init_vendor_properties() Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG cinder.volume.driver [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6894226074219, 'free_capacity_gb': 1775.6894226074219, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88736) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG oslo_db.sqlalchemy.engines [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88736) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writer thread running {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG cinder.db.api [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Building query based on filter {{(pid=88736) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88736) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:56 devstack cinder-volume[88736]: INFO cinder.keymgr.migration [None req-9c442086-7535-48bc-847f-1238d900dafb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 05 10:23:56 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:23:56 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:56 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.238s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:23:56 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Driver initialization completed successfully. Aug 05 10:23:56 devstack cinder-volume[88736]: INFO cinder.manager [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Initiating service 3 cleanup Aug 05 10:23:56 devstack cinder-volume[88736]: INFO cinder.manager [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Service 3 cleanup completed. Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG cinder.service [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Creating RPC server for service cinder-volume {{(pid=88736) start /opt/stack/cinder/cinder/service.py:231}} Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG cinder.service [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88736) start /opt/stack/cinder/cinder/service.py:237}} Aug 05 10:23:56 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:23:56 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:23:56 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:23:56 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Aug 05 10:23:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.234s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:23:56 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e1a2a498-afa1-4158-b7d6-8c7226def2c2 None None] Driver post RPC initialization completed successfully. Aug 05 10:24:05 devstack cinder-volume[88432]: DEBUG dbcounter [-] [88432] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:24:06 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=1 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:24:06 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:24:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:24:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 6 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:24:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:25:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:25:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:13 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:25:13 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:14 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.745s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:25:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:25:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 6 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:25:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Flow 'volume_create_manager' (768137f1-9d6f-4280-9391-58c374efcab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7be16e5-535b-4c3c-a8d7-debc03102dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7be16e5-535b-4c3c-a8d7-debc03102dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1849374087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8334a53c-fda1-4043-be3e-14f828f631d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e6d030b406495c92b32cd1216011af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:25Z,use_quota=True,user_id='f4c493abbce147728da24bae9696c35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671c2428-a8a4-4efa-b492-671273e4d50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671c2428-a8a4-4efa-b492-671273e4d50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97252600-53e3-4810-b98e-d03002d0e788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97252600-53e3-4810-b98e-d03002d0e788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8334a53c-fda1-4043-be3e-14f828f631d2', 'volume_name': 'volume-8334a53c-fda1-4043-be3e-14f828f631d2', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c00e6c-97b8-404a-a547-7ca80e062f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c00e6c-97b8-404a-a547-7ca80e062f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386aad58-dba5-40da-ba4f-6641082d0fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:25 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Volume 8334a53c-fda1-4043-be3e-14f828f631d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8334a53c-fda1-4043-be3e-14f828f631d2', 'volume_size': 1} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1849374087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8334a53c-fda1-4043-be3e-14f828f631d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e6d030b406495c92b32cd1216011af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:25Z,use_quota=True,user_id='f4c493abbce147728da24bae9696c35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Creating volume 8334a53c-fda1-4043-be3e-14f828f631d2 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:25:25 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:25:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8334a53c-fda1-4043-be3e-14f828f631d2 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:25 devstack sudo[89849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8334a53c-fda1-4043-be3e-14f828f631d2 1073741824 Aug 05 10:25:25 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:26 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8334a53c-fda1-4043-be3e-14f828f631d2 1073741824" returned: 0 in 1.006s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8334a53c-fda1-4043-be3e-14f828f631d2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:26 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8334a53c-fda1-4043-be3e-14f828f631d2 Aug 05 10:25:26 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:27 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8334a53c-fda1-4043-be3e-14f828f631d2" returned: 0 in 0.398s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:27 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:25:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386aad58-dba5-40da-ba4f-6641082d0fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8334a53c-fda1-4043-be3e-14f828f631d2', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd7a01f-c3fc-4bb6-b68f-ae14aa7a4e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:27 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Volume volume-8334a53c-fda1-4043-be3e-14f828f631d2 (8334a53c-fda1-4043-be3e-14f828f631d2): created successfully Aug 05 10:25:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd7a01f-c3fc-4bb6-b68f-ae14aa7a4e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Flow 'volume_create_manager' (768137f1-9d6f-4280-9391-58c374efcab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:27 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-648dee88-a878-47dc-b890-e4b572b058c2 tempest-VolumesAdminNegativeTest-1194308664 None] Created volume successfully. Aug 05 10:25:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Acquiring lock "cinder-8334a53c-fda1-4043-be3e-14f828f631d2-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Lock "cinder-8334a53c-fda1-4043-be3e-14f828f631d2-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Acquiring lock "cinder-quobyte-8334a53c-fda1-4043-be3e-14f828f631d2" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:25:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Lock "cinder-quobyte-8334a53c-fda1-4043-be3e-14f828f631d2" acquired by "delete_volume" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:25:28 devstack cinder-volume[88736]: INFO oslo.privsep.daemon [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2ha458rm/privsep.sock'] Aug 05 10:25:28 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2ha458rm/privsep.sock Aug 05 10:25:28 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:29 devstack cinder-volume[88736]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 05 10:25:29 devstack cinder-volume[88736]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 10:25:29 devstack cinder-volume[88736]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 05 10:25:29 devstack cinder-volume[88736]: WARNING oslo.privsep.daemon [-] privsep log: Aug 05 10:25:29 devstack cinder-volume[88736]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 05 10:25:29 devstack cinder-volume[88736]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 05 10:25:29 devstack cinder-volume[88736]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 10:25:29 devstack cinder-volume[88736]: WARNING oslo.privsep.daemon [-] privsep log: Aug 05 10:25:29 devstack cinder-volume[88736]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 05 10:25:29 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:29 devstack cinder-volume[88736]: INFO oslo.privsep.daemon [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Spawned new privsep daemon via rootwrap Aug 05 10:25:29 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Accepted privsep connection to /tmp/tmp2ha458rm/privsep.sock {{(pid=88736) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 05 10:25:29 devstack cinder-volume[88736]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 05 10:25:29 devstack cinder-volume[88736]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 05 10:25:29 devstack cinder-volume[88736]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 05 10:25:29 devstack cinder-volume[88736]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90235 Aug 05 10:25:29 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[acddeef3-447a-453e-9954-612cf716b85f]: (2,) {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:29 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b357616f-f138-4582-be44-e5ecf7a67f52]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:25:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8334a53c-fda1-4043-be3e-14f828f631d2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:30 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8334a53c-fda1-4043-be3e-14f828f631d2 Aug 05 10:25:30 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:30 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8334a53c-fda1-4043-be3e-14f828f631d2" returned: 0 in 0.424s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8334a53c-fda1-4043-be3e-14f828f631d2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:30 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8334a53c-fda1-4043-be3e-14f828f631d2 Aug 05 10:25:30 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:30 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8334a53c-fda1-4043-be3e-14f828f631d2" returned: 0 in 0.245s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Lock "cinder-quobyte-8334a53c-fda1-4043-be3e-14f828f631d2" released by "delete_volume" :: held 1.928s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:30 devstack cinder-volume[88736]: WARNING cinder.quota [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:25:30 devstack cinder-volume[88736]: WARNING cinder.quota [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:25:30 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Created reservations ['7f910d7c-0998-4ab6-a4ac-4fffb0ddec0c', 'd33133e7-1244-4528-a2e9-15eb8f897be1', 'a083c632-6e03-4929-b896-14fa7138a896', 'b7233beb-7540-4b39-9fb1-a606c9b76ad3'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:25:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:30 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:25:30 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:31 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.318s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:31 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:25:31 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Deleted volume successfully. Aug 05 10:25:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-fc37a98a-18e2-4865-ac12-3e9851e3528e tempest-VolumesAdminNegativeTest-1194308664 None] Lock "cinder-8334a53c-fda1-4043-be3e-14f828f631d2-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:25:40 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:25:40 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:25:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Flow 'volume_create_manager' (b998e942-6fba-4cd6-95be-471df99e4640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53265c43-ce5d-4424-99c7-63f0aac4d0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53265c43-ce5d-4424-99c7-63f0aac4d0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1435849453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4717ad39-ecd1-4e0d-81a4-ebba42f46360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404d66f6b43a4c8f8808e71d037a552d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:41Z,use_quota=True,user_id='9a98b0119f7a4751901760a60d59a83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583cfdd7-61f6-4542-92a3-8801ddf043b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583cfdd7-61f6-4542-92a3-8801ddf043b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1526c69-4587-4b9f-9241-b59543b116c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1526c69-4587-4b9f-9241-b59543b116c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4717ad39-ecd1-4e0d-81a4-ebba42f46360', 'volume_name': 'volume-4717ad39-ecd1-4e0d-81a4-ebba42f46360', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dff09b1-2975-4600-b41c-95a1ffd459b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dff09b1-2975-4600-b41c-95a1ffd459b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d596e1d-e168-4796-b69c-1dedf8e5c3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:41 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Volume 4717ad39-ecd1-4e0d-81a4-ebba42f46360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4717ad39-ecd1-4e0d-81a4-ebba42f46360', 'volume_size': 1} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1435849453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4717ad39-ecd1-4e0d-81a4-ebba42f46360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404d66f6b43a4c8f8808e71d037a552d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:41Z,use_quota=True,user_id='9a98b0119f7a4751901760a60d59a83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Creating volume 4717ad39-ecd1-4e0d-81a4-ebba42f46360 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:25:41 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4717ad39-ecd1-4e0d-81a4-ebba42f46360 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:41 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4717ad39-ecd1-4e0d-81a4-ebba42f46360 1073741824 Aug 05 10:25:41 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:41 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4717ad39-ecd1-4e0d-81a4-ebba42f46360 1073741824" returned: 0 in 0.593s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4717ad39-ecd1-4e0d-81a4-ebba42f46360 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:41 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4717ad39-ecd1-4e0d-81a4-ebba42f46360 Aug 05 10:25:41 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Flow 'volume_create_manager' (88eec75f-4943-4762-a8ed-903bb910a3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f3f3de-2bf2-4835-a1f1-5eb3b5e51fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:42 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f3f3de-2bf2-4835-a1f1-5eb3b5e51fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1839104934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d848daa6-f4d6-4a77-b180-9fe27f269a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e11c5ca3e4df7aaf0b95210b99aed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:42Z,use_quota=True,user_id='f0d8e64ad809489fba001c9eee5846d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b9f9ea-6b30-4880-9fc6-dd1ddcbe2e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b9f9ea-6b30-4880-9fc6-dd1ddcbe2e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0f48fb-d58e-4e8f-99fd-2118d28d1ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0f48fb-d58e-4e8f-99fd-2118d28d1ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd848daa6-f4d6-4a77-b180-9fe27f269a55', 'volume_name': 'volume-d848daa6-f4d6-4a77-b180-9fe27f269a55', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb08c78-df75-4bdb-b774-d191fd1ff9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb08c78-df75-4bdb-b774-d191fd1ff9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12732d2d-fb51-4859-b6c1-0d83d1394ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:42 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Volume d848daa6-f4d6-4a77-b180-9fe27f269a55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d848daa6-f4d6-4a77-b180-9fe27f269a55', 'volume_size': 1} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4717ad39-ecd1-4e0d-81a4-ebba42f46360" returned: 0 in 0.378s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1839104934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d848daa6-f4d6-4a77-b180-9fe27f269a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e11c5ca3e4df7aaf0b95210b99aed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:42Z,use_quota=True,user_id='f0d8e64ad809489fba001c9eee5846d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Creating volume d848daa6-f4d6-4a77-b180-9fe27f269a55 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:25:42 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d848daa6-f4d6-4a77-b180-9fe27f269a55 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d596e1d-e168-4796-b69c-1dedf8e5c3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4717ad39-ecd1-4e0d-81a4-ebba42f46360', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f13970-c29a-4465-8b0c-f0c0dd432ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:42 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d848daa6-f4d6-4a77-b180-9fe27f269a55 1073741824 Aug 05 10:25:42 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:42 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Volume volume-4717ad39-ecd1-4e0d-81a4-ebba42f46360 (4717ad39-ecd1-4e0d-81a4-ebba42f46360): created successfully Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f13970-c29a-4465-8b0c-f0c0dd432ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Flow 'volume_create_manager' (b998e942-6fba-4cd6-95be-471df99e4640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:42 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-61f33d3c-9dd4-4c88-8c5d-fcdefb6424fb tempest-AttachVolumeShelveTestJSON-989072706 None] Created volume successfully. Aug 05 10:25:42 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d848daa6-f4d6-4a77-b180-9fe27f269a55 1073741824" returned: 0 in 0.504s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d848daa6-f4d6-4a77-b180-9fe27f269a55 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:42 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d848daa6-f4d6-4a77-b180-9fe27f269a55 Aug 05 10:25:42 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:25:43 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Aug 05 10:25:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d848daa6-f4d6-4a77-b180-9fe27f269a55" returned: 0 in 0.295s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:25:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:25:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12732d2d-fb51-4859-b6c1-0d83d1394ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d848daa6-f4d6-4a77-b180-9fe27f269a55', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (495ba11e-185b-42f0-b22b-42ba2f5bc46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:43 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Volume volume-d848daa6-f4d6-4a77-b180-9fe27f269a55 (d848daa6-f4d6-4a77-b180-9fe27f269a55): created successfully Aug 05 10:25:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (495ba11e-185b-42f0-b22b-42ba2f5bc46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Flow 'volume_create_manager' (88eec75f-4943-4762-a8ed-903bb910a3a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:43 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-97c1a5ac-0ad8-45e2-b96a-1d37b63fb61f tempest-AttachVolumeNegativeTest-627035277 None] Created volume successfully. Aug 05 10:25:47 devstack cinder-volume[88736]: WARNING py.warnings [req-cc679c6d-05b3-4f14-b418-a4e1c54de96f req-6e9f02d9-4727-42b2-8e65-d62942976b1c tempest-AttachVolumeNegativeTest-627035277 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Aug 05 10:25:47 devstack cinder-volume[88736]: .first() Aug 05 10:25:47 devstack cinder-volume[88736]: Aug 05 10:25:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-cc679c6d-05b3-4f14-b418-a4e1c54de96f req-6e9f02d9-4727-42b2-8e65-d62942976b1c tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-cc679c6d-05b3-4f14-b418-a4e1c54de96f req-6e9f02d9-4727-42b2-8e65-d62942976b1c tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-cc679c6d-05b3-4f14-b418-a4e1c54de96f req-6e9f02d9-4727-42b2-8e65-d62942976b1c tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-cc679c6d-05b3-4f14-b418-a4e1c54de96f req-6e9f02d9-4727-42b2-8e65-d62942976b1c tempest-AttachVolumeNegativeTest-627035277 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-d848daa6-f4d6-4a77-b180-9fe27f269a55', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '569df95a-043a-4831-9598-341d4b86640a', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:25:48 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-cc679c6d-05b3-4f14-b418-a4e1c54de96f req-6e9f02d9-4727-42b2-8e65-d62942976b1c tempest-AttachVolumeNegativeTest-627035277 None] attachment_update completed successfully. Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-e42a72a9-788e-42bb-b498-1f46443889e8 req-503c9e03-e409-4e1a-bfed-fc44dd90ef09 tempest-AttachVolumeShelveTestJSON-989072706 None] No connector for attachment 0c17213b-8501-479b-a1f8-2e7992c225a4; skipping storage backend terminate_connection call. {{(pid=88736) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-e42a72a9-788e-42bb-b498-1f46443889e8 req-503c9e03-e409-4e1a-bfed-fc44dd90ef09 tempest-AttachVolumeShelveTestJSON-989072706 None] Deleting attachment 0c17213b-8501-479b-a1f8-2e7992c225a4. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Flow 'volume_create_manager' (c23c2606-feb8-46fd-b85f-7d8ac6d093fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3298112e-9c49-4383-bacd-85c1080912d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3298112e-9c49-4383-bacd-85c1080912d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-970106439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd95c545-48b2-422e-9f6b-1a56b4e6df0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3ff54f46d04842bc3f17387bfb2816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:59Z,use_quota=True,user_id='002ad75b3e4e4557985cd8b6ee846a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21f42a6-bf0c-4427-be8f-39c13155187b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21f42a6-bf0c-4427-be8f-39c13155187b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70195bbf-2235-49fb-8d28-85dbce66f9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70195bbf-2235-49fb-8d28-85dbce66f9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd95c545-48b2-422e-9f6b-1a56b4e6df0d', 'volume_name': 'volume-cd95c545-48b2-422e-9f6b-1a56b4e6df0d', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfe1bb8-be6e-459a-987e-586d34b56b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfe1bb8-be6e-459a-987e-586d34b56b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199baf95-1bbe-4389-963c-fb841615ee19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:25:59 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Volume cd95c545-48b2-422e-9f6b-1a56b4e6df0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd95c545-48b2-422e-9f6b-1a56b4e6df0d', 'volume_size': 1} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-970106439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd95c545-48b2-422e-9f6b-1a56b4e6df0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3ff54f46d04842bc3f17387bfb2816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:25:59Z,use_quota=True,user_id='002ad75b3e4e4557985cd8b6ee846a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Creating volume cd95c545-48b2-422e-9f6b-1a56b4e6df0d {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:25:59 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:25:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cd95c545-48b2-422e-9f6b-1a56b4e6df0d 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:25:59 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cd95c545-48b2-422e-9f6b-1a56b4e6df0d 1073741824 Aug 05 10:25:59 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:00 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cd95c545-48b2-422e-9f6b-1a56b4e6df0d 1073741824" returned: 0 in 1.058s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cd95c545-48b2-422e-9f6b-1a56b4e6df0d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:00 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cd95c545-48b2-422e-9f6b-1a56b4e6df0d Aug 05 10:26:00 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:01 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cd95c545-48b2-422e-9f6b-1a56b4e6df0d" returned: 0 in 0.536s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:26:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199baf95-1bbe-4389-963c-fb841615ee19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd95c545-48b2-422e-9f6b-1a56b4e6df0d', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce451a4-a42d-44de-9e38-d0c83ad41d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:01 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Volume volume-cd95c545-48b2-422e-9f6b-1a56b4e6df0d (cd95c545-48b2-422e-9f6b-1a56b4e6df0d): created successfully Aug 05 10:26:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce451a4-a42d-44de-9e38-d0c83ad41d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Flow 'volume_create_manager' (c23c2606-feb8-46fd-b85f-7d8ac6d093fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:26:01 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-4fda9c09-ab9c-4a9d-83ed-b05a95fa2bfa tempest-DeleteServersTestJSON-1255271818 None] Created volume successfully. Aug 05 10:26:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-6986b0a9-b865-41db-900f-1aa94d4a19a0 req-00e25863-dc63-4d83-a3c4-ca95aa728cc3 tempest-DeleteServersTestJSON-1255271818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-6986b0a9-b865-41db-900f-1aa94d4a19a0 req-00e25863-dc63-4d83-a3c4-ca95aa728cc3 tempest-DeleteServersTestJSON-1255271818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-6986b0a9-b865-41db-900f-1aa94d4a19a0 req-00e25863-dc63-4d83-a3c4-ca95aa728cc3 tempest-DeleteServersTestJSON-1255271818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-6986b0a9-b865-41db-900f-1aa94d4a19a0 req-00e25863-dc63-4d83-a3c4-ca95aa728cc3 tempest-DeleteServersTestJSON-1255271818 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-cd95c545-48b2-422e-9f6b-1a56b4e6df0d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f485316e-e602-4ba3-92f9-a43d9a08c2b0', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:26:03 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-6986b0a9-b865-41db-900f-1aa94d4a19a0 req-00e25863-dc63-4d83-a3c4-ca95aa728cc3 tempest-DeleteServersTestJSON-1255271818 None] attachment_update completed successfully. Aug 05 10:26:07 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-2ef50618-b506-423f-8abf-f565c72f23b9 req-98f93c24-6734-43bc-8cb4-44dbfb638669 tempest-DeleteServersTestJSON-1255271818 None] Terminate volume connection completed successfully. Aug 05 10:26:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-2ef50618-b506-423f-8abf-f565c72f23b9 req-98f93c24-6734-43bc-8cb4-44dbfb638669 tempest-DeleteServersTestJSON-1255271818 None] Deleting attachment f485316e-e602-4ba3-92f9-a43d9a08c2b0. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:26:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] Acquiring lock "cinder-cd95c545-48b2-422e-9f6b-1a56b4e6df0d-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] Lock "cinder-cd95c545-48b2-422e-9f6b-1a56b4e6df0d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] Acquiring lock "cinder-quobyte-cd95c545-48b2-422e-9f6b-1a56b4e6df0d" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] Lock "cinder-quobyte-cd95c545-48b2-422e-9f6b-1a56b4e6df0d" acquired by "delete_volume" :: waited 0.046s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:10 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dc54bd-9f16-4cb8-8f31-55aeedd3860d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cd95c545-48b2-422e-9f6b-1a56b4e6df0d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:10 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cd95c545-48b2-422e-9f6b-1a56b4e6df0d Aug 05 10:26:11 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:11 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cd95c545-48b2-422e-9f6b-1a56b4e6df0d" returned: 0 in 0.638s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cd95c545-48b2-422e-9f6b-1a56b4e6df0d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:11 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cd95c545-48b2-422e-9f6b-1a56b4e6df0d Aug 05 10:26:11 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:12 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cd95c545-48b2-422e-9f6b-1a56b4e6df0d" returned: 0 in 0.627s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] Lock "cinder-quobyte-cd95c545-48b2-422e-9f6b-1a56b4e6df0d" released by "delete_volume" :: held 1.352s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:12 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] Created reservations ['5674abba-8fdd-49d0-a9fb-ad756a292220', '861ec24f-bbec-4712-8834-e665a7dcb206', '6b9f23dd-51a1-429d-a9d0-2c4a34976443', 'ec9c99f2-6f31-4a83-b9d9-8625e23444fb'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:26:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:12 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:26:12 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:12 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.430s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:12 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:26:12 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] Deleted volume successfully. Aug 05 10:26:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-eb354263-e4f9-4344-8747-0981b5074aa3 tempest-DeleteServersTestJSON-1255271818 None] Lock "cinder-cd95c545-48b2-422e-9f6b-1a56b4e6df0d-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:26:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:13 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:26:13 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:14 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.461s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:26:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:26:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 8 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:26:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:26:22 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:UPDATE=35,cinder:SELECT=31,cinder:INSERT=6,cinder:DELETE=3 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:26:22 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=30,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=2 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Flow 'volume_create_manager' (cb667b8a-c038-4596-8045-737c0ab0ab78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b21a5e-10dc-4851-97b7-08faeae2ab18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b21a5e-10dc-4851-97b7-08faeae2ab18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-752477814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca8f2f1-845e-408b-bf76-34350dc3a4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf01613bb0a94a5699370d0384416c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:26:38Z,use_quota=True,user_id='ce69ad813f4d47408b7f5427cbc1650c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c28439d-1426-4890-9c52-34bffe1394b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c28439d-1426-4890-9c52-34bffe1394b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bece61c2-8755-4bad-a0fd-64bd6c6f5265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bece61c2-8755-4bad-a0fd-64bd6c6f5265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca8f2f1-845e-408b-bf76-34350dc3a4d8', 'volume_name': 'volume-6ca8f2f1-845e-408b-bf76-34350dc3a4d8', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52cc50c-e358-4e96-84da-1a621bf25d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52cc50c-e358-4e96-84da-1a621bf25d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd28c7ed-8c60-430b-b28e-5bfe6e246130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:38 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Volume 6ca8f2f1-845e-408b-bf76-34350dc3a4d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca8f2f1-845e-408b-bf76-34350dc3a4d8', 'volume_size': 1} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-752477814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca8f2f1-845e-408b-bf76-34350dc3a4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf01613bb0a94a5699370d0384416c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:26:38Z,use_quota=True,user_id='ce69ad813f4d47408b7f5427cbc1650c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Creating volume 6ca8f2f1-845e-408b-bf76-34350dc3a4d8 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:26:38 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6ca8f2f1-845e-408b-bf76-34350dc3a4d8 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:38 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6ca8f2f1-845e-408b-bf76-34350dc3a4d8 1073741824 Aug 05 10:26:38 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:38 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6ca8f2f1-845e-408b-bf76-34350dc3a4d8 1073741824" returned: 0 in 0.564s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6ca8f2f1-845e-408b-bf76-34350dc3a4d8 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:38 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6ca8f2f1-845e-408b-bf76-34350dc3a4d8 Aug 05 10:26:38 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:39 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6ca8f2f1-845e-408b-bf76-34350dc3a4d8" returned: 0 in 0.345s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:26:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd28c7ed-8c60-430b-b28e-5bfe6e246130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca8f2f1-845e-408b-bf76-34350dc3a4d8', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb59967-ee9c-4ea8-9223-2ac5bec15f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:26:39 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Volume volume-6ca8f2f1-845e-408b-bf76-34350dc3a4d8 (6ca8f2f1-845e-408b-bf76-34350dc3a4d8): created successfully Aug 05 10:26:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb59967-ee9c-4ea8-9223-2ac5bec15f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:26:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Flow 'volume_create_manager' (cb667b8a-c038-4596-8045-737c0ab0ab78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:26:39 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-849f6bb5-e233-4b23-a96c-0ee45eb298a0 tempest-TaggedAttachmentsTest-1101053138 None] Created volume successfully. Aug 05 10:26:43 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-4c81e5db-6993-4a94-a704-3dded84a9075 req-94a08719-54f5-42a0-b515-2e626eab8e0e tempest-AttachVolumeNegativeTest-627035277 None] Terminate volume connection completed successfully. Aug 05 10:26:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-4c81e5db-6993-4a94-a704-3dded84a9075 req-94a08719-54f5-42a0-b515-2e626eab8e0e tempest-AttachVolumeNegativeTest-627035277 None] Deleting attachment 569df95a-043a-4831-9598-341d4b86640a. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:26:49 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:DELETE=1 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:26:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] Acquiring lock "cinder-4717ad39-ecd1-4e0d-81a4-ebba42f46360-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] Lock "cinder-4717ad39-ecd1-4e0d-81a4-ebba42f46360-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] Acquiring lock "cinder-quobyte-4717ad39-ecd1-4e0d-81a4-ebba42f46360" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:26:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] Lock "cinder-quobyte-4717ad39-ecd1-4e0d-81a4-ebba42f46360" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:26:51 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8aba1b-574a-4eaf-9a87-5e63c35a97b3]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:26:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4717ad39-ecd1-4e0d-81a4-ebba42f46360 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:51 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4717ad39-ecd1-4e0d-81a4-ebba42f46360 Aug 05 10:26:51 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:52 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4717ad39-ecd1-4e0d-81a4-ebba42f46360" returned: 0 in 0.492s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4717ad39-ecd1-4e0d-81a4-ebba42f46360 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:52 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4717ad39-ecd1-4e0d-81a4-ebba42f46360 Aug 05 10:26:52 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:52 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4717ad39-ecd1-4e0d-81a4-ebba42f46360" returned: 0 in 0.325s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] Lock "cinder-quobyte-4717ad39-ecd1-4e0d-81a4-ebba42f46360" released by "delete_volume" :: held 0.865s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:26:52 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] Created reservations ['27d9435e-7f70-4e7d-80c5-1d9a69491f57', 'ef2c6a45-c041-4ae9-b70e-ce737b4457f9', 'e2bfb5bf-b493-46d3-ab0c-51f45054dcfd', 'd40fa579-b964-495a-a618-290f714309cd'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:26:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:26:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:26:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:26:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:26:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:26:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:26:52 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:26:52 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:26:52 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Aug 05 10:26:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.276s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:26:52 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:26:52 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] Deleted volume successfully. Aug 05 10:26:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-125183db-9d01-4ab5-82cc-8afb2b7f0d2a tempest-AttachVolumeShelveTestJSON-989072706 None] Lock "cinder-4717ad39-ecd1-4e0d-81a4-ebba42f46360-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:02 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:27:02 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Flow 'volume_create_manager' (1a22ef39-772a-4cc0-9925-424ef60feb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd088d20-3ae5-4daa-ba0a-57f8e3cddbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd088d20-3ae5-4daa-ba0a-57f8e3cddbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1219942577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6db152-3fd8-4cf8-805e-2f2b62397518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09b5b3483d0446909a06d2fc625f1ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:27:09Z,use_quota=True,user_id='bcf8885f39ce4ab29d4b3438485a8126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5e8369-2a50-4063-9384-db725c687b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5e8369-2a50-4063-9384-db725c687b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (decd3a3f-0489-488e-ab05-a120d1461a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (decd3a3f-0489-488e-ab05-a120d1461a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db6db152-3fd8-4cf8-805e-2f2b62397518', 'volume_name': 'volume-db6db152-3fd8-4cf8-805e-2f2b62397518', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6410548a-4273-4969-a96c-2ee5a436a821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6410548a-4273-4969-a96c-2ee5a436a821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810ab2c6-c35f-450f-a227-9ed901e4bfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:09 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Volume db6db152-3fd8-4cf8-805e-2f2b62397518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db6db152-3fd8-4cf8-805e-2f2b62397518', 'volume_size': 1} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1219942577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6db152-3fd8-4cf8-805e-2f2b62397518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09b5b3483d0446909a06d2fc625f1ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:27:09Z,use_quota=True,user_id='bcf8885f39ce4ab29d4b3438485a8126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Creating volume db6db152-3fd8-4cf8-805e-2f2b62397518 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:27:09 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:27:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:09 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518 1073741824 Aug 05 10:27:09 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:10 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518 1073741824" returned: 0 in 0.831s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:10 devstack sudo[91793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518 Aug 05 10:27:10 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:10 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518" returned: 0 in 0.342s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:27:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810ab2c6-c35f-450f-a227-9ed901e4bfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db6db152-3fd8-4cf8-805e-2f2b62397518', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d378bfb3-ba6f-4f15-b10d-66146bfa3d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:10 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Volume volume-db6db152-3fd8-4cf8-805e-2f2b62397518 (db6db152-3fd8-4cf8-805e-2f2b62397518): created successfully Aug 05 10:27:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d378bfb3-ba6f-4f15-b10d-66146bfa3d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Flow 'volume_create_manager' (1a22ef39-772a-4cc0-9925-424ef60feb45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:27:10 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-16a11d75-0341-4b8d-9b8d-0be9c4768d3a req-f9006479-0ac0-48b4-bc9d-969a5fa6edab tempest-VolumesSnapshotsTestJSON-1876470002 None] Created volume successfully. Aug 05 10:27:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] Creating offline snapshot b494d3f9-e047-466c-8c4b-a57a211c2995 of volume db6db152-3fd8-4cf8-805e-2f2b62397518 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:27:12 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8635285-e6e1-4b8e-b86a-f5572403f866]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:27:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:13 devstack sudo[91798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518 Aug 05 10:27:13 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:13 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518" returned: 0 in 0.798s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:13 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995 1G Aug 05 10:27:13 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:27:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:27:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:27:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:13 devstack sudo[91832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:27:13 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:14 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.756s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:27:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:27:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 8 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:27:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:27:14 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995 1G" returned: 0 in 1.114s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db6db152-3fd8-4cf8-805e-2f2b62397518 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:14 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db6db152-3fd8-4cf8-805e-2f2b62397518 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995 Aug 05 10:27:14 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:15 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db6db152-3fd8-4cf8-805e-2f2b62397518 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995" returned: 0 in 0.537s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:15 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995 is being set with open permissions: ugo+rw Aug 05 10:27:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:15 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995 Aug 05 10:27:15 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:15 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995" returned: 0 in 0.339s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:15 devstack sudo[91870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.info Aug 05 10:27:15 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:15 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.info" returned: 0 in 0.316s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:16 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.info is being set with open permissions: ugo+rw Aug 05 10:27:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:16 devstack sudo[91873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.info Aug 05 10:27:16 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:16 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.info" returned: 0 in 0.263s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.581s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:16 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-121fedfa-8c67-48a7-a75a-1d32e49d898d req-e80fbfcf-eb70-432f-b1e8-50c270befa9c tempest-VolumesSnapshotsTestJSON-1876470002 None] Create snapshot completed successfully Aug 05 10:27:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Acquiring lock "cinder-b494d3f9-e047-466c-8c4b-a57a211c2995-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "cinder-b494d3f9-e047-466c-8c4b-a57a211c2995-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Acquiring lock "cinder-quobyte-db6db152-3fd8-4cf8-805e-2f2b62397518" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "cinder-quobyte-db6db152-3fd8-4cf8-805e-2f2b62397518" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Acquiring lock "cinder-quobyte-b494d3f9-e047-466c-8c4b-a57a211c2995" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "cinder-quobyte-b494d3f9-e047-466c-8c4b-a57a211c2995" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:16 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Deleting offline snapshot b494d3f9-e047-466c-8c4b-a57a211c2995 of volume db6db152-3fd8-4cf8-805e-2f2b62397518 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:27:16 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] snapshot_file for this snap is: volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:27:16 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0361c8-2430-4ee2-8502-56b0290f5b1a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:27:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:17 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995 Aug 05 10:27:17 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:17 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995" returned: 0 in 0.377s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db6db152-3fd8-4cf8-805e-2f2b62397518(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:27:17 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[769cd3e9-7192-419a-b9bb-82497488cc95]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:27:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:17 devstack sudo[91881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518 Aug 05 10:27:17 devstack sudo[91881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:17 devstack sudo[91881]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518" returned: 0 in 0.361s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:17 devstack sudo[91886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995 Aug 05 10:27:17 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:18 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995" returned: 0 in 0.338s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:18 devstack sudo[91891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995 Aug 05 10:27:18 devstack sudo[91891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:18 devstack sudo[91891]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518.b494d3f9-e047-466c-8c4b-a57a211c2995" returned: 0 in 0.248s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "cinder-quobyte-b494d3f9-e047-466c-8c4b-a57a211c2995" released by "_delete_snapshot" :: held 1.430s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "cinder-quobyte-db6db152-3fd8-4cf8-805e-2f2b62397518" released by "delete_snapshot" :: held 1.457s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:18 devstack cinder-volume[88736]: WARNING cinder.quota [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:27:18 devstack cinder-volume[88736]: DEBUG cinder.quota [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Created reservations ['fb0311ff-912d-4d74-8ade-914771ee10d0', '82ff9105-e8e0-44fc-86e2-3248ad693309', '5d494bd8-002e-4fe2-bf14-94495cf4ba5a', '20d78ba0-a47c-4cc8-b91e-36a575f832e4'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:27:18 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Delete snapshot completed successfully. Aug 05 10:27:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-1e016b85-19bf-465c-82f9-77f9ab128952 req-41facc70-f00e-4f57-9a80-d8af81614ac0 tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "cinder-b494d3f9-e047-466c-8c4b-a57a211c2995-delete_snapshot" released by "delete_snapshot" :: held 1.608s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] Acquiring lock "cinder-db6db152-3fd8-4cf8-805e-2f2b62397518-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "cinder-db6db152-3fd8-4cf8-805e-2f2b62397518-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] Acquiring lock "cinder-quobyte-db6db152-3fd8-4cf8-805e-2f2b62397518" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "cinder-quobyte-db6db152-3fd8-4cf8-805e-2f2b62397518" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:19 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[024e80e5-e4d8-4d40-9d95-c6ad57c1d414]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:27:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:19 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518 Aug 05 10:27:19 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:19 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518" returned: 0 in 0.360s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:19 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518 Aug 05 10:27:19 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:19 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-db6db152-3fd8-4cf8-805e-2f2b62397518" returned: 0 in 0.253s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "cinder-quobyte-db6db152-3fd8-4cf8-805e-2f2b62397518" released by "delete_volume" :: held 0.676s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:19 devstack cinder-volume[88736]: DEBUG cinder.quota [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] Created reservations ['562024dc-d9d8-45c4-9d6c-3ad69e3e10d8', '95909696-b599-42b1-99e5-4b2567e6dfae', '2a99aefb-a58e-4497-b6cc-a1ce48649f0e', '095638ba-1b9d-4fab-981d-7e42a7db24eb'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:27:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:20 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:27:20 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:27:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:20 devstack sudo[91904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:27:20 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:20 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.273s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:20 devstack cinder-volume[88736]: DEBUG cinder.manager [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:27:20 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] Deleted volume successfully. Aug 05 10:27:20 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-7342471d-e238-4e70-8fbe-a09585a31961 req-ef2ab775-09a6-4206-9c4b-dfa9fb6f0adb tempest-VolumesSnapshotsTestJSON-1876470002 None] Lock "cinder-db6db152-3fd8-4cf8-805e-2f2b62397518-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-6cacc266-30d5-46f7-aa71-81d6f8f6a65a req-02ca5f6b-44f5-4a0e-81aa-c18ab0e87aa1 tempest-TaggedAttachmentsTest-1101053138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-6cacc266-30d5-46f7-aa71-81d6f8f6a65a req-02ca5f6b-44f5-4a0e-81aa-c18ab0e87aa1 tempest-TaggedAttachmentsTest-1101053138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-6cacc266-30d5-46f7-aa71-81d6f8f6a65a req-02ca5f6b-44f5-4a0e-81aa-c18ab0e87aa1 tempest-TaggedAttachmentsTest-1101053138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-6cacc266-30d5-46f7-aa71-81d6f8f6a65a req-02ca5f6b-44f5-4a0e-81aa-c18ab0e87aa1 tempest-TaggedAttachmentsTest-1101053138 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-6ca8f2f1-845e-408b-bf76-34350dc3a4d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc1bc775-9af6-4b32-b7a5-a6f48cc68645', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:27:29 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-6cacc266-30d5-46f7-aa71-81d6f8f6a65a req-02ca5f6b-44f5-4a0e-81aa-c18ab0e87aa1 tempest-TaggedAttachmentsTest-1101053138 None] attachment_update completed successfully. Aug 05 10:27:29 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7ed1b807-b2db-448c-bdba-649695b594a8 tempest-GroupsV320Test-2032588746 None] Group tempest-GroupsV320Test-Group-526106372: creating Aug 05 10:27:30 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7ed1b807-b2db-448c-bdba-649695b594a8 tempest-GroupsV320Test-2032588746 None] Group tempest-GroupsV320Test-Group-526106372: created successfully Aug 05 10:27:30 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7ed1b807-b2db-448c-bdba-649695b594a8 tempest-GroupsV320Test-2032588746 None] Create group completed successfully. Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Flow 'volume_create_manager' (73617833-7dca-4264-948f-d2c9d928551d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4666847-2a0c-4140-9762-49e5904cdd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4666847-2a0c-4140-9762-49e5904cdd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1955692108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b836fdf-8ca1-40ff-b721-444ff5b2b722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2a0414367c462a997b57816298cb13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:27:31Z,use_quota=True,user_id='ff9f10b4586e47b7b52bf539718c147b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ed735e-95f2-4076-b7e5-a02e84234d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ed735e-95f2-4076-b7e5-a02e84234d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590e7b9f-d7b4-432d-b6ce-10301dae972b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590e7b9f-d7b4-432d-b6ce-10301dae972b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b836fdf-8ca1-40ff-b721-444ff5b2b722', 'volume_name': 'volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b413deba-3f92-4fe2-a132-6273a23046b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b413deba-3f92-4fe2-a132-6273a23046b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd9ac1f-6a53-452c-b320-dd1574520f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:31 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Volume 0b836fdf-8ca1-40ff-b721-444ff5b2b722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722', 'volume_size': 1} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1955692108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b836fdf-8ca1-40ff-b721-444ff5b2b722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2a0414367c462a997b57816298cb13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:27:31Z,use_quota=True,user_id='ff9f10b4586e47b7b52bf539718c147b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Creating volume 0b836fdf-8ca1-40ff-b721-444ff5b2b722 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:27:31 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:31 devstack sudo[92421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722 1073741824 Aug 05 10:27:31 devstack sudo[92421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-8abe3991-cfb8-403a-a542-cfeef68a38d3 tempest-GroupsV320Test-2032588746 None] Created reservations ['cd2fa3fa-e25d-466d-8a29-503487231d4d'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8abe3991-cfb8-403a-a542-cfeef68a38d3 tempest-GroupsV320Test-2032588746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8abe3991-cfb8-403a-a542-cfeef68a38d3 tempest-GroupsV320Test-2032588746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8abe3991-cfb8-403a-a542-cfeef68a38d3 tempest-GroupsV320Test-2032588746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8abe3991-cfb8-403a-a542-cfeef68a38d3 tempest-GroupsV320Test-2032588746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8abe3991-cfb8-403a-a542-cfeef68a38d3 tempest-GroupsV320Test-2032588746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8abe3991-cfb8-403a-a542-cfeef68a38d3 tempest-GroupsV320Test-2032588746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:31 devstack sudo[92431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:27:31 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:31 devstack sudo[92421]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722 1073741824" returned: 0 in 0.716s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:32 devstack sudo[92433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722 Aug 05 10:27:32 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:32 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722" returned: 0 in 0.358s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:27:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd9ac1f-6a53-452c-b320-dd1574520f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ab0c8a-46e2-45e4-b163-9f2367d6a7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:32 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Volume volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722 (0b836fdf-8ca1-40ff-b721-444ff5b2b722): created successfully Aug 05 10:27:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ab0c8a-46e2-45e4-b163-9f2367d6a7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Flow 'volume_create_manager' (73617833-7dca-4264-948f-d2c9d928551d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:27:32 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8abe3991-cfb8-403a-a542-cfeef68a38d3 tempest-GroupsV320Test-2032588746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.571s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:32 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-8abe3991-cfb8-403a-a542-cfeef68a38d3 tempest-GroupsV320Test-2032588746 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:27:32 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8abe3991-cfb8-403a-a542-cfeef68a38d3 tempest-GroupsV320Test-2032588746 None] Delete group completed successfully. Aug 05 10:27:32 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-4817a175-dba4-4965-817e-fdca1585ca54 tempest-ServerActionsTestOtherA-983179334 None] Created volume successfully. Aug 05 10:27:33 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-43ec05f4-4f8f-4ac3-bf7d-f9f781051dd7 req-acb21a2c-9692-48fe-bbd9-7c1a4eaf639c tempest-TaggedAttachmentsTest-1101053138 None] Terminate volume connection completed successfully. Aug 05 10:27:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-43ec05f4-4f8f-4ac3-bf7d-f9f781051dd7 req-acb21a2c-9692-48fe-bbd9-7c1a4eaf639c tempest-TaggedAttachmentsTest-1101053138 None] Deleting attachment fc1bc775-9af6-4b32-b7a5-a6f48cc68645. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Flow 'volume_create_manager' (eb356724-2640-490e-b026-7c0e16bb385b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128577d5-6cf4-495d-8734-1f18481b4263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128577d5-6cf4-495d-8734-1f18481b4263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-21983814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab1eaba-f137-4efc-8374-684ede01855e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e11c5ca3e4df7aaf0b95210b99aed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:27:36Z,use_quota=True,user_id='f0d8e64ad809489fba001c9eee5846d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97d3d1a-dcec-4c0c-bf9f-5815c4ed1250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97d3d1a-dcec-4c0c-bf9f-5815c4ed1250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b35b67-36b0-454e-85bd-00efb2a8f5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b35b67-36b0-454e-85bd-00efb2a8f5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ab1eaba-f137-4efc-8374-684ede01855e', 'volume_name': 'volume-5ab1eaba-f137-4efc-8374-684ede01855e', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db6d989-e3d0-43d0-bfa7-c95e06934940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db6d989-e3d0-43d0-bfa7-c95e06934940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa63f859-541a-49dd-ba6a-98106b310db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:35 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Volume 5ab1eaba-f137-4efc-8374-684ede01855e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ab1eaba-f137-4efc-8374-684ede01855e', 'volume_size': 1} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-21983814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab1eaba-f137-4efc-8374-684ede01855e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e11c5ca3e4df7aaf0b95210b99aed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:27:36Z,use_quota=True,user_id='f0d8e64ad809489fba001c9eee5846d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Creating volume 5ab1eaba-f137-4efc-8374-684ede01855e {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:27:35 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:27:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5ab1eaba-f137-4efc-8374-684ede01855e 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:35 devstack sudo[92494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5ab1eaba-f137-4efc-8374-684ede01855e 1073741824 Aug 05 10:27:35 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:36 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5ab1eaba-f137-4efc-8374-684ede01855e 1073741824" returned: 0 in 0.688s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5ab1eaba-f137-4efc-8374-684ede01855e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:36 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5ab1eaba-f137-4efc-8374-684ede01855e Aug 05 10:27:36 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:37 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5ab1eaba-f137-4efc-8374-684ede01855e" returned: 0 in 0.352s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:37 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:27:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:37 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa63f859-541a-49dd-ba6a-98106b310db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab1eaba-f137-4efc-8374-684ede01855e', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:37 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46afe21-a9b9-4430-b96e-b3b5e4727a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:37 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Volume volume-5ab1eaba-f137-4efc-8374-684ede01855e (5ab1eaba-f137-4efc-8374-684ede01855e): created successfully Aug 05 10:27:37 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46afe21-a9b9-4430-b96e-b3b5e4727a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:37 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Flow 'volume_create_manager' (eb356724-2640-490e-b026-7c0e16bb385b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:27:37 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-34275795-42ef-430c-be0d-153aff171b16 tempest-AttachVolumeNegativeTest-627035277 None] Created volume successfully. Aug 05 10:27:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-2e1f4118-9e04-4d73-9f11-920056b1840a req-da2ffe3a-a4f6-4dc3-b508-880f029d8225 tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-2e1f4118-9e04-4d73-9f11-920056b1840a req-da2ffe3a-a4f6-4dc3-b508-880f029d8225 tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-2e1f4118-9e04-4d73-9f11-920056b1840a req-da2ffe3a-a4f6-4dc3-b508-880f029d8225 tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-2e1f4118-9e04-4d73-9f11-920056b1840a req-da2ffe3a-a4f6-4dc3-b508-880f029d8225 tempest-AttachVolumeNegativeTest-627035277 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-5ab1eaba-f137-4efc-8374-684ede01855e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '807ea458-d9de-4f77-b4b7-6607f4064a31', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:27:39 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-2e1f4118-9e04-4d73-9f11-920056b1840a req-da2ffe3a-a4f6-4dc3-b508-880f029d8225 tempest-AttachVolumeNegativeTest-627035277 None] attachment_update completed successfully. Aug 05 10:27:42 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-bdb01a20-bf14-4b15-8f31-4f8b6ee6a16f req-24fcbfcf-7af7-4349-ac5e-7647a492104b tempest-AttachVolumeNegativeTest-627035277 None] Terminate volume connection completed successfully. Aug 05 10:27:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-bdb01a20-bf14-4b15-8f31-4f8b6ee6a16f req-24fcbfcf-7af7-4349-ac5e-7647a492104b tempest-AttachVolumeNegativeTest-627035277 None] Deleting attachment 807ea458-d9de-4f77-b4b7-6607f4064a31. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Flow 'volume_create_manager' (dc6a3b63-5b2d-4311-87e9-e41b5e36af39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa6d734f-1690-414a-af62-bac142e2ee49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa6d734f-1690-414a-af62-bac142e2ee49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1653032048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01cbd273-97d0-407a-9485-f15f9816ab13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca4d4cd61f54656986065863b5d3284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:27:44Z,use_quota=True,user_id='418acbe89fbc46e79fae842be5b29e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a1d1454-688b-4a91-9983-85d56d886051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a1d1454-688b-4a91-9983-85d56d886051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a902256-0764-43ed-9c3b-0ab4c15c7197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a902256-0764-43ed-9c3b-0ab4c15c7197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01cbd273-97d0-407a-9485-f15f9816ab13', 'volume_name': 'volume-01cbd273-97d0-407a-9485-f15f9816ab13', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b002b7-c4c4-4550-918a-2615b2ae3fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b002b7-c4c4-4550-918a-2615b2ae3fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553eeb4e-5beb-4c25-b42f-4c94adfc902b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:44 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Volume 01cbd273-97d0-407a-9485-f15f9816ab13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01cbd273-97d0-407a-9485-f15f9816ab13', 'volume_size': 1} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1653032048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01cbd273-97d0-407a-9485-f15f9816ab13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca4d4cd61f54656986065863b5d3284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:27:44Z,use_quota=True,user_id='418acbe89fbc46e79fae842be5b29e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Creating volume 01cbd273-97d0-407a-9485-f15f9816ab13 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:27:44 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:27:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01cbd273-97d0-407a-9485-f15f9816ab13 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:44 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01cbd273-97d0-407a-9485-f15f9816ab13 1073741824 Aug 05 10:27:44 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:45 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01cbd273-97d0-407a-9485-f15f9816ab13 1073741824" returned: 0 in 0.860s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01cbd273-97d0-407a-9485-f15f9816ab13 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:45 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01cbd273-97d0-407a-9485-f15f9816ab13 Aug 05 10:27:45 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:46 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01cbd273-97d0-407a-9485-f15f9816ab13" returned: 0 in 0.764s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:27:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553eeb4e-5beb-4c25-b42f-4c94adfc902b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01cbd273-97d0-407a-9485-f15f9816ab13', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afa2504-90ca-4527-86aa-a89858728894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:46 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Volume volume-01cbd273-97d0-407a-9485-f15f9816ab13 (01cbd273-97d0-407a-9485-f15f9816ab13): created successfully Aug 05 10:27:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afa2504-90ca-4527-86aa-a89858728894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Flow 'volume_create_manager' (dc6a3b63-5b2d-4311-87e9-e41b5e36af39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:27:46 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-4a7a46fe-bc99-4de7-8e68-edb38c6f90d5 tempest-VolumeQuotasAdminTestJSON-24417638 None] Created volume successfully. Aug 05 10:27:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] Acquiring lock "cinder-6ca8f2f1-845e-408b-bf76-34350dc3a4d8-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] Lock "cinder-6ca8f2f1-845e-408b-bf76-34350dc3a4d8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] Acquiring lock "cinder-quobyte-6ca8f2f1-845e-408b-bf76-34350dc3a4d8" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] Lock "cinder-quobyte-6ca8f2f1-845e-408b-bf76-34350dc3a4d8" acquired by "delete_volume" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:46 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0fe368-b041-4135-b719-459d90adb615]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:27:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6ca8f2f1-845e-408b-bf76-34350dc3a4d8 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:46 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6ca8f2f1-845e-408b-bf76-34350dc3a4d8 Aug 05 10:27:46 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:47 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6ca8f2f1-845e-408b-bf76-34350dc3a4d8" returned: 0 in 0.528s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6ca8f2f1-845e-408b-bf76-34350dc3a4d8 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:47 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6ca8f2f1-845e-408b-bf76-34350dc3a4d8 Aug 05 10:27:47 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] Acquiring lock "cinder-01cbd273-97d0-407a-9485-f15f9816ab13-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] Lock "cinder-01cbd273-97d0-407a-9485-f15f9816ab13-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] Acquiring lock "cinder-quobyte-01cbd273-97d0-407a-9485-f15f9816ab13" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] Lock "cinder-quobyte-01cbd273-97d0-407a-9485-f15f9816ab13" acquired by "delete_volume" :: waited 0.033s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:47 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3e10f2-6e6f-411f-a6ad-5daef296eb42]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:27:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01cbd273-97d0-407a-9485-f15f9816ab13 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:47 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6ca8f2f1-845e-408b-bf76-34350dc3a4d8" returned: 0 in 0.611s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:47 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01cbd273-97d0-407a-9485-f15f9816ab13 Aug 05 10:27:47 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] Lock "cinder-quobyte-6ca8f2f1-845e-408b-bf76-34350dc3a4d8" released by "delete_volume" :: held 1.203s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:48 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] Created reservations ['cb00c5f7-1506-4e56-b9c6-df35bce6b60e', 'ff9ee42b-80b9-44de-b93a-bdbdf27d53cc', '41f1e783-23ae-4810-9245-7e0b6cb5c1eb', '775699a3-783c-4a86-b881-c14e73b65cf7'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:27:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:27:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:27:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:48 devstack sudo[93097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:27:48 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:48 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01cbd273-97d0-407a-9485-f15f9816ab13" returned: 0 in 0.582s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01cbd273-97d0-407a-9485-f15f9816ab13 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:48 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01cbd273-97d0-407a-9485-f15f9816ab13 Aug 05 10:27:48 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:48 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.417s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:48 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:27:48 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] Deleted volume successfully. Aug 05 10:27:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b25d8c38-8983-40b7-b6fa-23f97dc17bb0 tempest-TaggedAttachmentsTest-1101053138 None] Lock "cinder-6ca8f2f1-845e-408b-bf76-34350dc3a4d8-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:48 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01cbd273-97d0-407a-9485-f15f9816ab13" returned: 0 in 0.461s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] Lock "cinder-quobyte-01cbd273-97d0-407a-9485-f15f9816ab13" released by "delete_volume" :: held 1.105s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:48 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] Created reservations ['51134269-df83-4dd1-88ee-a927070c19c3', 'c0f21be4-f58c-4a0d-99b4-f73b90b74102', '0529c3bc-7e5b-4c82-af68-343e38be5d1d', '1ef3565e-04d6-4333-b799-f1d0355f2fce'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:27:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:27:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:27:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:49 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:27:49 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:49 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.389s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:49 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:27:49 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] Deleted volume successfully. Aug 05 10:27:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2706bb07-5f28-4c7c-828e-ad993865936e tempest-VolumeQuotasAdminTestJSON-24417638 None] Lock "cinder-01cbd273-97d0-407a-9485-f15f9816ab13-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Flow 'volume_create_manager' (72d542da-270e-47bf-94eb-64f68943d29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591e8f2b-a1ec-4172-ae45-3c533a2c78e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591e8f2b-a1ec-4172-ae45-3c533a2c78e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-461894195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59b912a-310a-4ebb-afa3-b904a36844b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca4d4cd61f54656986065863b5d3284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:27:51Z,use_quota=True,user_id='418acbe89fbc46e79fae842be5b29e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b5ba09-c254-4000-9e56-b83f1e44dfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b5ba09-c254-4000-9e56-b83f1e44dfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb08d70-f989-484b-ab32-e6f12100d2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb08d70-f989-484b-ab32-e6f12100d2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f59b912a-310a-4ebb-afa3-b904a36844b0', 'volume_name': 'volume-f59b912a-310a-4ebb-afa3-b904a36844b0', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022b07ab-0d9d-47ea-ac3d-15d0ecca65ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022b07ab-0d9d-47ea-ac3d-15d0ecca65ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a513bd0-9a9a-41d5-a7ad-985a6f4392bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:51 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Volume f59b912a-310a-4ebb-afa3-b904a36844b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f59b912a-310a-4ebb-afa3-b904a36844b0', 'volume_size': 1} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-461894195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59b912a-310a-4ebb-afa3-b904a36844b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca4d4cd61f54656986065863b5d3284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:27:51Z,use_quota=True,user_id='418acbe89fbc46e79fae842be5b29e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Creating volume f59b912a-310a-4ebb-afa3-b904a36844b0 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:27:51 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f59b912a-310a-4ebb-afa3-b904a36844b0 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:51 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f59b912a-310a-4ebb-afa3-b904a36844b0 1073741824 Aug 05 10:27:51 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:51 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f59b912a-310a-4ebb-afa3-b904a36844b0 1073741824" returned: 0 in 0.650s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f59b912a-310a-4ebb-afa3-b904a36844b0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:52 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f59b912a-310a-4ebb-afa3-b904a36844b0 Aug 05 10:27:52 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:52 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f59b912a-310a-4ebb-afa3-b904a36844b0" returned: 0 in 0.464s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:27:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a513bd0-9a9a-41d5-a7ad-985a6f4392bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f59b912a-310a-4ebb-afa3-b904a36844b0', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f2d27c-b5e9-49a3-98c8-e207547f112d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:27:52 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Volume volume-f59b912a-310a-4ebb-afa3-b904a36844b0 (f59b912a-310a-4ebb-afa3-b904a36844b0): created successfully Aug 05 10:27:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f2d27c-b5e9-49a3-98c8-e207547f112d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:27:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Flow 'volume_create_manager' (72d542da-270e-47bf-94eb-64f68943d29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:27:52 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ffc4b6c3-1d63-4a94-81c4-5e09ec1a2d7c tempest-VolumeQuotasAdminTestJSON-24417638 None] Created volume successfully. Aug 05 10:27:54 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-43eb8bea-fc25-43d1-b602-374b44a7e921 tempest-VolumeQuotasAdminTestJSON-163290844 None] Transfer volume completed successfully. Aug 05 10:27:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] Acquiring lock "cinder-f59b912a-310a-4ebb-afa3-b904a36844b0-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] Lock "cinder-f59b912a-310a-4ebb-afa3-b904a36844b0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] Acquiring lock "cinder-quobyte-f59b912a-310a-4ebb-afa3-b904a36844b0" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:27:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] Lock "cinder-quobyte-f59b912a-310a-4ebb-afa3-b904a36844b0" acquired by "delete_volume" :: waited 0.028s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:27:55 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[904515c9-8c7c-40e9-8e0c-c530e67cde5d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:27:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f59b912a-310a-4ebb-afa3-b904a36844b0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:55 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f59b912a-310a-4ebb-afa3-b904a36844b0 Aug 05 10:27:55 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:56 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f59b912a-310a-4ebb-afa3-b904a36844b0" returned: 0 in 0.554s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f59b912a-310a-4ebb-afa3-b904a36844b0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:56 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f59b912a-310a-4ebb-afa3-b904a36844b0 Aug 05 10:27:56 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:56 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f59b912a-310a-4ebb-afa3-b904a36844b0" returned: 0 in 0.401s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] Lock "cinder-quobyte-f59b912a-310a-4ebb-afa3-b904a36844b0" released by "delete_volume" :: held 1.029s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:27:56 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] Created reservations ['31890602-36a4-4a74-8392-57fadac92d56', 'b1c03b96-3a5a-4a27-9534-8176b50c9ce2', '7877b17f-ad5d-43dc-a515-1d9bf7ef2ad7', 'b5e68302-6bbf-46f4-a2bf-371b7d86ad36'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:27:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:27:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:27:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:27:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:27:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:27:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:27:56 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:27:56 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:27:57 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Aug 05 10:27:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.394s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:27:57 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:27:57 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] Deleted volume successfully. Aug 05 10:27:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ce9c2590-2374-46d9-91ff-de9aa227a14c tempest-VolumeQuotasAdminTestJSON-530997703 None] Lock "cinder-f59b912a-310a-4ebb-afa3-b904a36844b0-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:06 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:UPDATE=58,cinder:SELECT=60,cinder:INSERT=17,cinder:DELETE=2 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:28:07 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=63,cinder:UPDATE=64,cinder:DELETE=8,cinder:INSERT=10 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Flow 'volume_create_manager' (575abb1d-c51a-41aa-9fab-ec41605855c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c9ddef-bf66-418b-97d8-2276dca797c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c9ddef-bf66-418b-97d8-2276dca797c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-867046880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd716fcfa2e14fc6aafb4336b477397f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:09Z,use_quota=True,user_id='299c43e55f1a40028dfce8d901ff737f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00327add-70df-46f5-8ed5-2175956826ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00327add-70df-46f5-8ed5-2175956826ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6573a9-5eb5-4b5c-95c7-847165e36395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6573a9-5eb5-4b5c-95c7-847165e36395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738', 'volume_name': 'volume-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ad562e-4dc7-4773-9155-229537f2cc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ad562e-4dc7-4773-9155-229537f2cc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfa7904-d5a1-43f3-88d2-feeed37c1a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:08 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Volume 3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738', 'volume_size': 1} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-867046880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd716fcfa2e14fc6aafb4336b477397f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:09Z,use_quota=True,user_id='299c43e55f1a40028dfce8d901ff737f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Creating volume 3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:28:08 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:28:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:08 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738 1073741824 Aug 05 10:28:08 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:09 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738 1073741824" returned: 0 in 0.446s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:09 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738 Aug 05 10:28:09 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:09 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738" returned: 0 in 0.267s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:28:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfa7904-d5a1-43f3-88d2-feeed37c1a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290bcf82-9e25-4394-a34d-0118a0b87364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:09 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Volume volume-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738 (3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738): created successfully Aug 05 10:28:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290bcf82-9e25-4394-a34d-0118a0b87364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Flow 'volume_create_manager' (575abb1d-c51a-41aa-9fab-ec41605855c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:09 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-47a8211d-be08-45bd-a843-d825a2b09b8e req-de655143-7b88-4616-8c3c-d6c5167e5f14 tempest-VolumesGetTestJSON-1585091069 None] Created volume successfully. Aug 05 10:28:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] Acquiring lock "cinder-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] Lock "cinder-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] Acquiring lock "cinder-quobyte-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] Lock "cinder-quobyte-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738" acquired by "delete_volume" :: waited 0.031s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:10 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb96270-10bb-4abf-951b-d4bd317907dd]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:10 devstack sudo[93311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738 Aug 05 10:28:10 devstack sudo[93311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:10 devstack sudo[93311]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738" returned: 0 in 0.518s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:10 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738 Aug 05 10:28:10 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:11 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738" returned: 0 in 0.403s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] Lock "cinder-quobyte-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738" released by "delete_volume" :: held 0.980s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:11 devstack cinder-volume[88736]: DEBUG cinder.quota [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] Created reservations ['7add010e-b4e6-4243-87b5-ebd23f3398f9', '9330b8cc-0450-4891-a9c6-8a69d0aa4e4a', '644a33ce-e6e2-4fa2-8177-924f53f259b7', 'a81cca35-9c20-408f-b680-9bc909276947'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:28:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-60f4f804-db8c-47da-825f-9fbe78a1651d req-08a59058-ea96-415e-8f37-57e06f193e25 tempest-ServerActionsTestOtherA-983179334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-60f4f804-db8c-47da-825f-9fbe78a1651d req-08a59058-ea96-415e-8f37-57e06f193e25 tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-60f4f804-db8c-47da-825f-9fbe78a1651d req-08a59058-ea96-415e-8f37-57e06f193e25 tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-60f4f804-db8c-47da-825f-9fbe78a1651d req-08a59058-ea96-415e-8f37-57e06f193e25 tempest-ServerActionsTestOtherA-983179334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b53c4988-5d54-407e-8d1b-e0f0175520f2', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:28:11 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:28:11 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:11 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-60f4f804-db8c-47da-825f-9fbe78a1651d req-08a59058-ea96-415e-8f37-57e06f193e25 tempest-ServerActionsTestOtherA-983179334 None] attachment_update completed successfully. Aug 05 10:28:12 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.378s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:12 devstack cinder-volume[88736]: DEBUG cinder.manager [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:28:12 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] Deleted volume successfully. Aug 05 10:28:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-61d1d8a4-d775-4173-85fe-62870f1ef1dd req-8d2da56a-b932-4a59-82e4-33fba90425ef tempest-VolumesGetTestJSON-1585091069 None] Lock "cinder-3d8f0b15-76a1-44cd-9ce4-afcc2aaa7738-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:28:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:13 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:28:13 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:14 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.373s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:28:16 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-9af8aae1-5d81-405b-8b48-99ce02fa41a5 req-0a8bdbbc-8f11-4863-910b-2681f1a65498 tempest-ServerActionsTestOtherA-983179334 None] Terminate volume connection completed successfully. Aug 05 10:28:16 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-9af8aae1-5d81-405b-8b48-99ce02fa41a5 req-0a8bdbbc-8f11-4863-910b-2681f1a65498 tempest-ServerActionsTestOtherA-983179334 None] Deleting attachment b53c4988-5d54-407e-8d1b-e0f0175520f2. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:28:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-9af8aae1-5d81-405b-8b48-99ce02fa41a5 req-d2d5dfb5-f904-4e81-8688-7ffe3deb69aa tempest-ServerActionsTestOtherA-983179334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-9af8aae1-5d81-405b-8b48-99ce02fa41a5 req-d2d5dfb5-f904-4e81-8688-7ffe3deb69aa tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-9af8aae1-5d81-405b-8b48-99ce02fa41a5 req-d2d5dfb5-f904-4e81-8688-7ffe3deb69aa tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-9af8aae1-5d81-405b-8b48-99ce02fa41a5 req-d2d5dfb5-f904-4e81-8688-7ffe3deb69aa tempest-ServerActionsTestOtherA-983179334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f42f623-a86a-4be1-9473-4301472a697d', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:28:17 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-9af8aae1-5d81-405b-8b48-99ce02fa41a5 req-d2d5dfb5-f904-4e81-8688-7ffe3deb69aa tempest-ServerActionsTestOtherA-983179334 None] attachment_update completed successfully. Aug 05 10:28:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab4212ee-a4f4-4060-8eb1-89da1bec4de5 tempest-BackendsCapabilitiesAdminTestsJSON-2040426296 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6894226074219, 'free_capacity_gb': 1775.6894226074219, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88736) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 05 10:28:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-54e54595-3745-4153-8770-fb200df618b1 tempest-BackendsCapabilitiesAdminTestsJSON-2040426296 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6894226074219, 'free_capacity_gb': 1775.6894226074219, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88736) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Flow 'volume_create_manager' (03fc6794-984e-4709-a216-c1211f5a96fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2499f4-bfb5-46a2-ba37-2b49f76e7199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2499f4-bfb5-46a2-ba37-2b49f76e7199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-565584999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01908147-6aa6-4059-a6b4-612819badf5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6b7bfb8ccd423cb59171389eee33c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:23Z,use_quota=True,user_id='f6862adba1a94947a42e0d3fbdd5682f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60eb22a8-e87c-4a05-8828-8c487503bc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60eb22a8-e87c-4a05-8828-8c487503bc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f66fc4-a4be-42ac-8829-6731ffac5978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f66fc4-a4be-42ac-8829-6731ffac5978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01908147-6aa6-4059-a6b4-612819badf5f', 'volume_name': 'volume-01908147-6aa6-4059-a6b4-612819badf5f', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccbf288-7812-4175-885f-4f16ad539b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccbf288-7812-4175-885f-4f16ad539b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451dd16c-6de0-4280-9152-fb683b25983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:22 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Volume 01908147-6aa6-4059-a6b4-612819badf5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01908147-6aa6-4059-a6b4-612819badf5f', 'volume_size': 1} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-565584999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01908147-6aa6-4059-a6b4-612819badf5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6b7bfb8ccd423cb59171389eee33c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:23Z,use_quota=True,user_id='f6862adba1a94947a42e0d3fbdd5682f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Creating volume 01908147-6aa6-4059-a6b4-612819badf5f {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:28:22 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:28:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:22 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f 1073741824 Aug 05 10:28:22 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:23 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f 1073741824" returned: 0 in 0.562s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:23 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f Aug 05 10:28:23 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:23 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f" returned: 0 in 0.275s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:28:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451dd16c-6de0-4280-9152-fb683b25983b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01908147-6aa6-4059-a6b4-612819badf5f', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47312a4c-1002-48a7-a484-97d4274017a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:23 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Volume volume-01908147-6aa6-4059-a6b4-612819badf5f (01908147-6aa6-4059-a6b4-612819badf5f): created successfully Aug 05 10:28:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47312a4c-1002-48a7-a484-97d4274017a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Flow 'volume_create_manager' (03fc6794-984e-4709-a216-c1211f5a96fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:23 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-effc4859-5d9f-47d3-ad80-dd03f612395d tempest-VolumesDeleteCascade-399787454 None] Created volume successfully. Aug 05 10:28:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] Creating offline snapshot a784042b-3e1d-4de9-a8db-bc224dd35ba0 of volume 01908147-6aa6-4059-a6b4-612819badf5f {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:28:24 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca2210c-6535-4563-b972-2d796cb84944]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:25 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f Aug 05 10:28:25 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:25 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f" returned: 0 in 0.433s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:25 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 1G Aug 05 10:28:25 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:25 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 1G" returned: 0 in 0.580s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01908147-6aa6-4059-a6b4-612819badf5f -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:25 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01908147-6aa6-4059-a6b4-612819badf5f -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 Aug 05 10:28:25 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:26 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01908147-6aa6-4059-a6b4-612819badf5f -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0" returned: 0 in 0.373s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:26 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 is being set with open permissions: ugo+rw Aug 05 10:28:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:26 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 Aug 05 10:28:26 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:26 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0" returned: 0 in 0.318s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:26 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.info Aug 05 10:28:26 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:26 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.info" returned: 0 in 0.339s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:26 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.info is being set with open permissions: ugo+rw Aug 05 10:28:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:26 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.info Aug 05 10:28:26 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:27 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.info" returned: 0 in 0.346s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.498s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:27 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1b12e1b9-27b4-4d14-9b89-e78bc69be00d tempest-VolumesDeleteCascade-399787454 None] Create snapshot completed successfully Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Flow 'volume_create_manager' (723b73ae-5c1c-4a7d-92ac-ad669614ae0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e26904-15d5-4342-9273-d7461652b40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e26904-15d5-4342-9273-d7461652b40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-190636344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5924c2-dd13-4dac-8c22-61439b89e99d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e11c5ca3e4df7aaf0b95210b99aed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:28Z,use_quota=True,user_id='f0d8e64ad809489fba001c9eee5846d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3997fdfb-f798-4448-b309-58cacb0da364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3997fdfb-f798-4448-b309-58cacb0da364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c69f65-962a-4cee-bbb0-ac7b35ca8810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c69f65-962a-4cee-bbb0-ac7b35ca8810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f5924c2-dd13-4dac-8c22-61439b89e99d', 'volume_name': 'volume-6f5924c2-dd13-4dac-8c22-61439b89e99d', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485110b0-dea3-45de-949e-27299fd80e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485110b0-dea3-45de-949e-27299fd80e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04a687a-3099-4ca5-ba2e-c09b74dd0381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:28 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Volume 6f5924c2-dd13-4dac-8c22-61439b89e99d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f5924c2-dd13-4dac-8c22-61439b89e99d', 'volume_size': 1} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-190636344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5924c2-dd13-4dac-8c22-61439b89e99d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e11c5ca3e4df7aaf0b95210b99aed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:28Z,use_quota=True,user_id='f0d8e64ad809489fba001c9eee5846d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Creating volume 6f5924c2-dd13-4dac-8c22-61439b89e99d {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:28:28 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f5924c2-dd13-4dac-8c22-61439b89e99d 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ed010510-d691-41dc-b435-3edcc2449e27 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:28 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f5924c2-dd13-4dac-8c22-61439b89e99d 1073741824 Aug 05 10:28:28 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:28 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f5924c2-dd13-4dac-8c22-61439b89e99d 1073741824" returned: 0 in 0.521s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f5924c2-dd13-4dac-8c22-61439b89e99d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:28 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f5924c2-dd13-4dac-8c22-61439b89e99d Aug 05 10:28:28 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:29 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f5924c2-dd13-4dac-8c22-61439b89e99d" returned: 0 in 0.295s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:28:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ed010510-d691-41dc-b435-3edcc2449e27 tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.852s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04a687a-3099-4ca5-ba2e-c09b74dd0381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f5924c2-dd13-4dac-8c22-61439b89e99d', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142b24a0-d520-4d6f-b298-0ec7a43210e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-ed010510-d691-41dc-b435-3edcc2449e27 tempest-VolumesDeleteCascade-399787454 None] Creating offline snapshot 94bfc329-1791-47ec-9e4e-78d6a542a5f5 of volume 01908147-6aa6-4059-a6b4-612819badf5f {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:28:29 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cb44d5-77a2-4256-99b7-e3b046df45ba]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ed010510-d691-41dc-b435-3edcc2449e27 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:29 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Volume volume-6f5924c2-dd13-4dac-8c22-61439b89e99d (6f5924c2-dd13-4dac-8c22-61439b89e99d): created successfully Aug 05 10:28:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142b24a0-d520-4d6f-b298-0ec7a43210e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Flow 'volume_create_manager' (723b73ae-5c1c-4a7d-92ac-ad669614ae0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:29 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-96417cfd-d1df-4a23-acdf-440faeee21c6 tempest-AttachVolumeNegativeTest-627035277 None] Created volume successfully. Aug 05 10:28:29 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 Aug 05 10:28:29 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:29 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ed010510-d691-41dc-b435-3edcc2449e27 tempest-VolumesDeleteCascade-399787454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0" returned: 0 in 0.397s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-ed010510-d691-41dc-b435-3edcc2449e27 tempest-VolumesDeleteCascade-399787454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01908147-6aa6-4059-a6b4-612819badf5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:28:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ed010510-d691-41dc-b435-3edcc2449e27 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:29 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5 1G Aug 05 10:28:29 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:30 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ed010510-d691-41dc-b435-3edcc2449e27 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5 1G" returned: 0 in 0.512s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ed010510-d691-41dc-b435-3edcc2449e27 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:30 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5 Aug 05 10:28:30 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:30 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ed010510-d691-41dc-b435-3edcc2449e27 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5" returned: 0 in 0.433s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:30 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-ed010510-d691-41dc-b435-3edcc2449e27 tempest-VolumesDeleteCascade-399787454 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5 is being set with open permissions: ugo+rw Aug 05 10:28:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ed010510-d691-41dc-b435-3edcc2449e27 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:30 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5 Aug 05 10:28:30 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:31 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ed010510-d691-41dc-b435-3edcc2449e27 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5" returned: 0 in 0.318s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ed010510-d691-41dc-b435-3edcc2449e27 tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.823s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:31 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ed010510-d691-41dc-b435-3edcc2449e27 tempest-VolumesDeleteCascade-399787454 None] Create snapshot completed successfully Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-812ae691-b11b-4bb9-881f-9961c53a5121 req-65559f30-89f0-4ec1-bb84-6c271e7f143b tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-812ae691-b11b-4bb9-881f-9961c53a5121 req-65559f30-89f0-4ec1-bb84-6c271e7f143b tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-812ae691-b11b-4bb9-881f-9961c53a5121 req-65559f30-89f0-4ec1-bb84-6c271e7f143b tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "cinder-01908147-6aa6-4059-a6b4-612819badf5f-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-812ae691-b11b-4bb9-881f-9961c53a5121 req-65559f30-89f0-4ec1-bb84-6c271e7f143b tempest-AttachVolumeNegativeTest-627035277 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-6f5924c2-dd13-4dac-8c22-61439b89e99d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f09f5afd-92ff-4e39-bc12-d01be8df81d3', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-01908147-6aa6-4059-a6b4-612819badf5f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Performing cascade delete. {{(pid=88736) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "cinder-94bfc329-1791-47ec-9e4e-78d6a542a5f5-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:31 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-812ae691-b11b-4bb9-881f-9961c53a5121 req-65559f30-89f0-4ec1-bb84-6c271e7f143b tempest-AttachVolumeNegativeTest-627035277 None] attachment_update completed successfully. Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-94bfc329-1791-47ec-9e4e-78d6a542a5f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "cinder-quobyte-01908147-6aa6-4059-a6b4-612819badf5f" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-01908147-6aa6-4059-a6b4-612819badf5f" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "cinder-quobyte-94bfc329-1791-47ec-9e4e-78d6a542a5f5" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-94bfc329-1791-47ec-9e4e-78d6a542a5f5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Deleting offline snapshot 94bfc329-1791-47ec-9e4e-78d6a542a5f5 of volume 01908147-6aa6-4059-a6b4-612819badf5f {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] snapshot_file for this snap is: volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[23129999-5877-4ad6-bb43-21c1641b6bdc]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:31 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5 Aug 05 10:28:31 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:32 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5" returned: 0 in 0.604s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01908147-6aa6-4059-a6b4-612819badf5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:28:32 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-5b34d1ca-5490-488a-8729-694bca0f0ef5 tempest-GroupsTest-59173743 None] Group tempest-Group1-2110537085: creating Aug 05 10:28:32 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05ab085-15cf-4b97-9ac6-2687160fcc0f]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:32 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-5b34d1ca-5490-488a-8729-694bca0f0ef5 tempest-GroupsTest-59173743 None] Group tempest-Group1-2110537085: created successfully Aug 05 10:28:32 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-5b34d1ca-5490-488a-8729-694bca0f0ef5 tempest-GroupsTest-59173743 None] Create group completed successfully. Aug 05 10:28:32 devstack sudo[94405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 Aug 05 10:28:32 devstack sudo[94405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:32 devstack sudo[94405]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0" returned: 0 in 0.395s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01908147-6aa6-4059-a6b4-612819badf5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:28:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:32 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5 Aug 05 10:28:32 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:33 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5" returned: 0 in 0.369s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:33 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5 Aug 05 10:28:33 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:33 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-bd60f648-1108-40ae-9e5a-5613f1241a18 tempest-GroupsTest-59173743 None] Group tempest-Group2-1858248538: creating Aug 05 10:28:33 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-bd60f648-1108-40ae-9e5a-5613f1241a18 tempest-GroupsTest-59173743 None] Group tempest-Group2-1858248538: created successfully Aug 05 10:28:33 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-bd60f648-1108-40ae-9e5a-5613f1241a18 tempest-GroupsTest-59173743 None] Create group completed successfully. Aug 05 10:28:33 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.94bfc329-1791-47ec-9e4e-78d6a542a5f5" returned: 0 in 0.367s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-94bfc329-1791-47ec-9e4e-78d6a542a5f5" released by "_delete_snapshot" :: held 1.894s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-01908147-6aa6-4059-a6b4-612819badf5f" released by "delete_snapshot" :: held 1.925s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:33 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Created reservations ['82a836ba-1e3c-48b6-a4e6-e6cbe61cdafa', 'fa2c7a5f-3e95-45a2-95cf-8d544f1ecf91', 'a041d4e6-c03a-4b75-a8fb-0924ad61ef25', '6a8e9f86-aa43-4d05-9808-236a6f27c26a'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:28:33 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Delete snapshot completed successfully. Aug 05 10:28:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-94bfc329-1791-47ec-9e4e-78d6a542a5f5-delete_snapshot" released by "delete_snapshot" :: held 2.120s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "cinder-a784042b-3e1d-4de9-a8db-bc224dd35ba0-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-a784042b-3e1d-4de9-a8db-bc224dd35ba0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "cinder-quobyte-01908147-6aa6-4059-a6b4-612819badf5f" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-01908147-6aa6-4059-a6b4-612819badf5f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "cinder-quobyte-a784042b-3e1d-4de9-a8db-bc224dd35ba0" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-a784042b-3e1d-4de9-a8db-bc224dd35ba0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Deleting offline snapshot a784042b-3e1d-4de9-a8db-bc224dd35ba0 of volume 01908147-6aa6-4059-a6b4-612819badf5f {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:28:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] snapshot_file for this snap is: volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:28:33 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb15398-433b-4401-8e63-68caf5f41a8d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:34 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 Aug 05 10:28:34 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:34 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0" returned: 0 in 0.427s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01908147-6aa6-4059-a6b4-612819badf5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:28:34 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac81ad3-4fa3-44e4-8ff3-12c3c3dec90d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:34 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f Aug 05 10:28:34 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:34 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-88407e15-951f-4749-8f52-e93dc040021c req-f7a3ae8b-ca33-46f9-8bdb-9961ed8c3028 tempest-AttachVolumeNegativeTest-627035277 None] Terminate volume connection completed successfully. Aug 05 10:28:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-88407e15-951f-4749-8f52-e93dc040021c req-f7a3ae8b-ca33-46f9-8bdb-9961ed8c3028 tempest-AttachVolumeNegativeTest-627035277 None] Deleting attachment f09f5afd-92ff-4e39-bc12-d01be8df81d3. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:28:34 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f" returned: 0 in 0.438s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:34 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 Aug 05 10:28:34 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:28:35 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Flow 'volume_create_manager' (3d1885b4-9285-4103-9d04-4eefe06cc285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cfcf271-7a70-442c-8b9b-86583a1083df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0" returned: 0 in 0.600s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cfcf271-7a70-442c-8b9b-86583a1083df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1953527767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=913bd23a-cff1-45f3-89ef-ae22ce099b72,host='devstack@QuobyteHD#QuobyteHD',id=3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d159ebd75f2f4bb0bc087763e49f6725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:35Z,use_quota=True,user_id='a9b912f551984c2ebf258a16a5ce5eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c972a68-2cec-4298-b622-95aa9fb9f5a2),volume_type_id=3c972a68-2cec-4298-b622-95aa9fb9f5a2)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b08c72c-1e10-4d1c-af55-434c20b79ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:35 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0 Aug 05 10:28:35 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b08c72c-1e10-4d1c-af55-434c20b79ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2db387-02e0-4583-bafc-17092b25fd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2db387-02e0-4583-bafc-17092b25fd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9', 'volume_name': 'volume-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d0d927-3e28-41da-9644-a02e328b7877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d0d927-3e28-41da-9644-a02e328b7877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8615a11b-31a1-4eb2-88b6-a915e3f7a269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:35 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Volume 3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9', 'volume_size': 1} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=913bd23a-cff1-45f3-89ef-ae22ce099b72,created_at=2026-08-05T08:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1953527767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=913bd23a-cff1-45f3-89ef-ae22ce099b72,host='devstack@QuobyteHD#QuobyteHD',id=3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d159ebd75f2f4bb0bc087763e49f6725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:35Z,use_quota=True,user_id='a9b912f551984c2ebf258a16a5ce5eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c972a68-2cec-4298-b622-95aa9fb9f5a2),volume_type_id=3c972a68-2cec-4298-b622-95aa9fb9f5a2)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Creating volume 3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:28:35 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:35 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9 1073741824 Aug 05 10:28:35 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:35 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f.a784042b-3e1d-4de9-a8db-bc224dd35ba0" returned: 0 in 0.315s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-a784042b-3e1d-4de9-a8db-bc224dd35ba0" released by "_delete_snapshot" :: held 1.894s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-01908147-6aa6-4059-a6b4-612819badf5f" released by "delete_snapshot" :: held 1.918s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Created reservations ['645e7c07-2b30-4d7d-bde5-e4a7abf2831a', '72995588-8126-4b4d-8daf-3b1bdde91c15', 'e69b7260-1764-422d-b805-8890ef425041', '13aede6b-0fea-4682-bc15-3e042cceb487'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:28:35 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Delete snapshot completed successfully. Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-a784042b-3e1d-4de9-a8db-bc224dd35ba0-delete_snapshot" released by "delete_snapshot" :: held 2.097s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Snapshots deleted, issuing volume delete {{(pid=88736) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "cinder-quobyte-01908147-6aa6-4059-a6b4-612819badf5f" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:35 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-01908147-6aa6-4059-a6b4-612819badf5f" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:36 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e641f45-dc3a-4617-845c-3d7cbb6f38e0]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:36 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9 1073741824" returned: 0 in 0.578s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:36 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9 Aug 05 10:28:36 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:36 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f Aug 05 10:28:36 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:36 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9" returned: 0 in 0.318s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:28:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8615a11b-31a1-4eb2-88b6-a915e3f7a269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e201cde1-325c-4f1b-81c6-3380d83c8921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:36 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Volume volume-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9 (3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9): created successfully Aug 05 10:28:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e201cde1-325c-4f1b-81c6-3380d83c8921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Flow 'volume_create_manager' (3d1885b4-9285-4103-9d04-4eefe06cc285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:36 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f" returned: 0 in 0.591s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:36 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a58dc81e-1bfe-4ca4-b44a-cf912112f07d tempest-GroupsTest-59173743 None] Created volume successfully. Aug 05 10:28:36 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f Aug 05 10:28:36 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:36 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-01908147-6aa6-4059-a6b4-612819badf5f" returned: 0 in 0.285s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-01908147-6aa6-4059-a6b4-612819badf5f" released by "delete_volume" :: held 0.947s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:36 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Created reservations ['2b69ec38-56fd-45a6-8dae-703e96dbe7ae', '83ccefb3-26b1-4a29-af7b-5d3d8b6ac9dd', '90c89ecc-6cd5-438e-b60f-eaf8a64e8fd8', '229d18c0-8b6c-4d6b-9f02-5f28de661ce3'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:28:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:37 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:37 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:37 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:28:37 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:37 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.261s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:37 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:28:37 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Deleted volume successfully. Aug 05 10:28:37 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3431f2f-d399-48db-b15f-77e1df69e176 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-01908147-6aa6-4059-a6b4-612819badf5f-delete_volume" released by "delete_volume" :: held 5.750s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Flow 'volume_create_manager' (5512ebe2-5fb5-4e5b-985e-4b988a56e4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4973f6ec-6820-4583-a6c2-0b16d5b134cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4973f6ec-6820-4583-a6c2-0b16d5b134cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1301301184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213ce263-6cab-4611-8a97-2fd732895abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6b7bfb8ccd423cb59171389eee33c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:38Z,use_quota=True,user_id='f6862adba1a94947a42e0d3fbdd5682f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865b509e-b763-4b8e-a8d3-cdb23a1e8df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865b509e-b763-4b8e-a8d3-cdb23a1e8df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c45024-ceb9-439b-b319-87914058c0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c45024-ceb9-439b-b319-87914058c0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '213ce263-6cab-4611-8a97-2fd732895abc', 'volume_name': 'volume-213ce263-6cab-4611-8a97-2fd732895abc', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72446fa-35c3-41ae-b06b-7c511ef7b2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72446fa-35c3-41ae-b06b-7c511ef7b2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d818456-0d98-4928-b192-6e9a1693033e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:38 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Volume 213ce263-6cab-4611-8a97-2fd732895abc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-213ce263-6cab-4611-8a97-2fd732895abc', 'volume_size': 1} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1301301184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213ce263-6cab-4611-8a97-2fd732895abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6b7bfb8ccd423cb59171389eee33c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:38Z,use_quota=True,user_id='f6862adba1a94947a42e0d3fbdd5682f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Creating volume 213ce263-6cab-4611-8a97-2fd732895abc {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:28:38 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:38 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc 1073741824 Aug 05 10:28:38 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] Acquiring lock "cinder-quobyte-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] Lock "cinder-quobyte-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec9de20-4195-4f0e-8238-e70bb2be2ee2]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:38 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9 Aug 05 10:28:38 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:38 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc 1073741824" returned: 0 in 0.645s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:39 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc Aug 05 10:28:39 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:39 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9" returned: 0 in 0.409s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:39 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9 Aug 05 10:28:39 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:39 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc" returned: 0 in 0.273s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d818456-0d98-4928-b192-6e9a1693033e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-213ce263-6cab-4611-8a97-2fd732895abc', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7270f2b0-9ba9-45e3-be8c-a79b1cd90e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:39 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Volume volume-213ce263-6cab-4611-8a97-2fd732895abc (213ce263-6cab-4611-8a97-2fd732895abc): created successfully Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7270f2b0-9ba9-45e3-be8c-a79b1cd90e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Flow 'volume_create_manager' (5512ebe2-5fb5-4e5b-985e-4b988a56e4a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "cinder-6f5924c2-dd13-4dac-8c22-61439b89e99d-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] Lock "cinder-6f5924c2-dd13-4dac-8c22-61439b89e99d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:39 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-f16bcccd-5ed2-46fd-b5d1-6cd089b7a83c tempest-VolumesDeleteCascade-399787454 None] Created volume successfully. Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "cinder-quobyte-6f5924c2-dd13-4dac-8c22-61439b89e99d" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] Lock "cinder-quobyte-6f5924c2-dd13-4dac-8c22-61439b89e99d" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8087a4a-c60f-41fa-980b-ad8f6ea1349f]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f5924c2-dd13-4dac-8c22-61439b89e99d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:39 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9" returned: 0 in 0.261s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] Lock "cinder-quobyte-3b5f35fa-f9e2-43af-ab59-9cb0f3a6b8a9" released by "delete_volume" :: held 0.722s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:39 devstack sudo[94573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f5924c2-dd13-4dac-8c22-61439b89e99d Aug 05 10:28:39 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] Created reservations ['d32f0233-d176-4917-9a29-ae5f41558e62'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:28:39 devstack cinder-volume[88736]: WARNING cinder.quota [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-92281880 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-92281880, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:28:39 devstack cinder-volume[88736]: WARNING cinder.quota [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-92281880 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-92281880, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] Created reservations ['018b52b0-c005-4afd-9fff-231c108681bc', 'd1ee5a26-cae3-47a7-9370-1184934cdce0', 'afc95e30-2366-4a3a-9707-eab4867ed53d', '41a02c92-399f-4028-8d7e-2d7dbe1d5fa9'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:39 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:28:39 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:39 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f5924c2-dd13-4dac-8c22-61439b89e99d" returned: 0 in 0.363s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f5924c2-dd13-4dac-8c22-61439b89e99d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:39 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f5924c2-dd13-4dac-8c22-61439b89e99d Aug 05 10:28:39 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:39 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.269s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:39 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:28:39 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-5a29596b-efea-472d-99da-fc89720a1bd4 tempest-GroupsTest-59173743 None] Delete group completed successfully. Aug 05 10:28:40 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f5924c2-dd13-4dac-8c22-61439b89e99d" returned: 0 in 0.269s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] Lock "cinder-quobyte-6f5924c2-dd13-4dac-8c22-61439b89e99d" released by "delete_volume" :: held 0.672s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-1c253e23-6c9c-40f9-a239-9a1ddf054d57 tempest-GroupsTest-59173743 None] Created reservations ['40eb7dd0-e594-4059-b66e-77765e21453a'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] Created reservations ['65d5bf50-1e75-4008-afda-bf4486b7359d', 'ea7168f0-4899-4c77-8507-e33723141dd6', '3dbfcd0f-d1c2-49a0-8ebb-65f605380978', '252e100e-05d6-4519-9648-cee11e0cdd66'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1c253e23-6c9c-40f9-a239-9a1ddf054d57 tempest-GroupsTest-59173743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1c253e23-6c9c-40f9-a239-9a1ddf054d57 tempest-GroupsTest-59173743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1c253e23-6c9c-40f9-a239-9a1ddf054d57 tempest-GroupsTest-59173743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1c253e23-6c9c-40f9-a239-9a1ddf054d57 tempest-GroupsTest-59173743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1c253e23-6c9c-40f9-a239-9a1ddf054d57 tempest-GroupsTest-59173743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1c253e23-6c9c-40f9-a239-9a1ddf054d57 tempest-GroupsTest-59173743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:40 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:28:40 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:40 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:28:40 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:40 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.290s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] Creating offline snapshot dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 of volume 213ce263-6cab-4611-8a97-2fd732895abc {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:28:40 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] Deleted volume successfully. Aug 05 10:28:40 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1c253e23-6c9c-40f9-a239-9a1ddf054d57 tempest-GroupsTest-59173743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.402s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-1c253e23-6c9c-40f9-a239-9a1ddf054d57 tempest-GroupsTest-59173743 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:28:40 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1c253e23-6c9c-40f9-a239-9a1ddf054d57 tempest-GroupsTest-59173743 None] Delete group completed successfully. Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecacb785-9582-4eb6-971c-9f8f95ee2710]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-678b3c2d-5f92-446d-ab2e-97b2b47bbf7e tempest-AttachVolumeNegativeTest-627035277 None] Lock "cinder-6f5924c2-dd13-4dac-8c22-61439b89e99d-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "cinder-5ab1eaba-f137-4efc-8374-684ede01855e-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] Lock "cinder-5ab1eaba-f137-4efc-8374-684ede01855e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:40 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc Aug 05 10:28:40 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "cinder-quobyte-5ab1eaba-f137-4efc-8374-684ede01855e" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] Lock "cinder-quobyte-5ab1eaba-f137-4efc-8374-684ede01855e" acquired by "delete_volume" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4594c4ce-38a2-44ea-b4d8-8ab77621d889]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5ab1eaba-f137-4efc-8374-684ede01855e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:40 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5ab1eaba-f137-4efc-8374-684ede01855e Aug 05 10:28:40 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:41 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc" returned: 0 in 0.404s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:41 devstack sudo[94598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 1G Aug 05 10:28:41 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:41 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5ab1eaba-f137-4efc-8374-684ede01855e" returned: 0 in 0.427s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5ab1eaba-f137-4efc-8374-684ede01855e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:41 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5ab1eaba-f137-4efc-8374-684ede01855e Aug 05 10:28:41 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:41 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 1G" returned: 0 in 0.449s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-213ce263-6cab-4611-8a97-2fd732895abc -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:41 devstack sudo[94610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-213ce263-6cab-4611-8a97-2fd732895abc -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 Aug 05 10:28:41 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:41 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5ab1eaba-f137-4efc-8374-684ede01855e" returned: 0 in 0.346s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] Lock "cinder-quobyte-5ab1eaba-f137-4efc-8374-684ede01855e" released by "delete_volume" :: held 0.837s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:41 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] Created reservations ['bee664a7-5e89-4597-9757-bbbd6780609a', 'a2454f74-d7d6-4af5-a41a-6ac92616a78d', 'eaee73bf-29ef-4c44-bd51-2daf4012a6a1', '9b7d23f5-73a9-4b68-976d-ba3bc863e5e4'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:28:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:41 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ebaf24ab-bdc8-43f3-9c3b-7a89a845b828 tempest-GroupsTest-59173743 None] Group tempest-GroupsTest-Group-282769868: creating Aug 05 10:28:41 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:28:41 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:41 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-213ce263-6cab-4611-8a97-2fd732895abc -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468" returned: 0 in 0.424s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:41 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 is being set with open permissions: ugo+rw Aug 05 10:28:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:41 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 Aug 05 10:28:41 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:41 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ebaf24ab-bdc8-43f3-9c3b-7a89a845b828 tempest-GroupsTest-59173743 None] Group tempest-GroupsTest-Group-282769868: created successfully Aug 05 10:28:41 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ebaf24ab-bdc8-43f3-9c3b-7a89a845b828 tempest-GroupsTest-59173743 None] Create group completed successfully. Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "cinder-d848daa6-f4d6-4a77-b180-9fe27f269a55-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] Lock "cinder-d848daa6-f4d6-4a77-b180-9fe27f269a55-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:42 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.314s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:28:42 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] Deleted volume successfully. Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-552b7b2c-d25f-453f-87aa-bebb78859883 tempest-AttachVolumeNegativeTest-627035277 None] Lock "cinder-5ab1eaba-f137-4efc-8374-684ede01855e-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:42 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "cinder-quobyte-d848daa6-f4d6-4a77-b180-9fe27f269a55" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468" returned: 0 in 0.343s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] Lock "cinder-quobyte-d848daa6-f4d6-4a77-b180-9fe27f269a55" acquired by "delete_volume" :: waited 0.030s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c03e4e-6136-4eab-a74a-1bdd1531c7ed]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d848daa6-f4d6-4a77-b180-9fe27f269a55 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:42 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.info Aug 05 10:28:42 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:42 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d848daa6-f4d6-4a77-b180-9fe27f269a55 Aug 05 10:28:42 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:42 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.info" returned: 0 in 0.325s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:42 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.info is being set with open permissions: ugo+rw Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:42 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d848daa6-f4d6-4a77-b180-9fe27f269a55" returned: 0 in 0.365s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d848daa6-f4d6-4a77-b180-9fe27f269a55 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:42 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.info Aug 05 10:28:42 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:42 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d848daa6-f4d6-4a77-b180-9fe27f269a55 Aug 05 10:28:42 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:42 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.info" returned: 0 in 0.260s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:42 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d848daa6-f4d6-4a77-b180-9fe27f269a55" returned: 0 in 0.266s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] Lock "cinder-quobyte-d848daa6-f4d6-4a77-b180-9fe27f269a55" released by "delete_volume" :: held 0.684s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:42 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-9d70d731-8633-4aee-84d6-c3ab93019ca8 tempest-VolumesDeleteCascade-399787454 None] Create snapshot completed successfully Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] Created reservations ['44d2405f-ab14-44d4-a993-fbc702531e72', '6e80f03b-451c-4f54-b81f-1bbee8a45259', 'cd8da6d6-b847-4a3d-9f83-ec1d8f82f8c5', '2ae8cdd0-35b3-4680-b1d9-bad83a0bd5d6'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:43 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:28:43 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:43 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.271s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:28:43 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] Deleted volume successfully. Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3159a3d1-99e6-45a7-bc1c-16f662217183 tempest-AttachVolumeNegativeTest-627035277 None] Lock "cinder-d848daa6-f4d6-4a77-b180-9fe27f269a55-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Flow 'volume_create_manager' (84541b81-fe1f-4aa1-b2f0-36b4e1a65bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35c3757-ff82-422e-9f51-163b33e9d54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35c3757-ff82-422e-9f51-163b33e9d54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1394323860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63055427-f27f-46d9-89ba-cf3a55a5ca34,host='devstack@QuobyteHD#QuobyteHD',id=4dbb9641-16e4-4372-94ed-73a962a1dcde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d159ebd75f2f4bb0bc087763e49f6725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:43Z,use_quota=True,user_id='a9b912f551984c2ebf258a16a5ce5eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cac5106f-77f1-4af3-b117-4acc1605b8e2),volume_type_id=cac5106f-77f1-4af3-b117-4acc1605b8e2)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec857f1-3755-4339-a0cb-c93b19f1a526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec857f1-3755-4339-a0cb-c93b19f1a526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a114edbd-5be5-43e0-864f-35e2be904f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a114edbd-5be5-43e0-864f-35e2be904f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dbb9641-16e4-4372-94ed-73a962a1dcde', 'volume_name': 'volume-4dbb9641-16e4-4372-94ed-73a962a1dcde', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5c4e3f-df44-46fb-ab0f-60926f94e663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5c4e3f-df44-46fb-ab0f-60926f94e663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38fb60b0-cc4f-4d4a-aab4-c96eef2e6ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:43 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Volume 4dbb9641-16e4-4372-94ed-73a962a1dcde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dbb9641-16e4-4372-94ed-73a962a1dcde', 'volume_size': 1} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63055427-f27f-46d9-89ba-cf3a55a5ca34,created_at=2026-08-05T08:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1394323860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63055427-f27f-46d9-89ba-cf3a55a5ca34,host='devstack@QuobyteHD#QuobyteHD',id=4dbb9641-16e4-4372-94ed-73a962a1dcde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d159ebd75f2f4bb0bc087763e49f6725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:43Z,use_quota=True,user_id='a9b912f551984c2ebf258a16a5ce5eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cac5106f-77f1-4af3-b117-4acc1605b8e2),volume_type_id=cac5106f-77f1-4af3-b117-4acc1605b8e2)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Creating volume 4dbb9641-16e4-4372-94ed-73a962a1dcde {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:28:43 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:28:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4dbb9641-16e4-4372-94ed-73a962a1dcde 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:43 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4dbb9641-16e4-4372-94ed-73a962a1dcde 1073741824 Aug 05 10:28:43 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:44 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4dbb9641-16e4-4372-94ed-73a962a1dcde 1073741824" returned: 0 in 0.550s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4dbb9641-16e4-4372-94ed-73a962a1dcde {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:44 devstack sudo[94654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4dbb9641-16e4-4372-94ed-73a962a1dcde Aug 05 10:28:44 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Flow 'volume_create_manager' (7ccfa8a1-780e-4160-bb22-f7c258b6a165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3b5bf7-38ab-4c4f-bc5c-fb99b1b3f8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3b5bf7-38ab-4c4f-bc5c-fb99b1b3f8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-591176617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972dbe1d-1cea-438b-9169-8cfc31000c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6b7bfb8ccd423cb59171389eee33c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dd53a52d-7ee7-4fd0-95f9-766c8fa0d468,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:44Z,use_quota=True,user_id='f6862adba1a94947a42e0d3fbdd5682f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b40c24d-7c67-4f94-8882-839b2abf27bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:44 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b40c24d-7c67-4f94-8882-839b2abf27bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5249cc-d9d7-487f-a95e-ebbb4b677b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5249cc-d9d7-487f-a95e-ebbb4b677b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '972dbe1d-1cea-438b-9169-8cfc31000c22', 'volume_name': 'volume-972dbe1d-1cea-438b-9169-8cfc31000c22', 'volume_size': 1, 'snapshot_id': 'dd53a52d-7ee7-4fd0-95f9-766c8fa0d468'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1768049a-41c5-4b5b-bfc2-ed1037334690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1768049a-41c5-4b5b-bfc2-ed1037334690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4e1a1e-c1b0-4f37-80d5-eabcc24e31ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:44 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Volume 972dbe1d-1cea-438b-9169-8cfc31000c22: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-972dbe1d-1cea-438b-9169-8cfc31000c22', 'volume_size': 1, 'snapshot_id': 'dd53a52d-7ee7-4fd0-95f9-766c8fa0d468'} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4dbb9641-16e4-4372-94ed-73a962a1dcde" returned: 0 in 0.437s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "cinder-quobyte-dd53a52d-7ee7-4fd0-95f9-766c8fa0d468-972dbe1d-1cea-438b-9169-8cfc31000c22" by "_create_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38fb60b0-cc4f-4d4a-aab4-c96eef2e6ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dbb9641-16e4-4372-94ed-73a962a1dcde', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050e4bfd-b296-43e4-afc0-efe67f0a83fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-dd53a52d-7ee7-4fd0-95f9-766c8fa0d468-972dbe1d-1cea-438b-9169-8cfc31000c22" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Creating volume 972dbe1d-1cea-438b-9169-8cfc31000c22 from snapshot dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 {{(pid=88736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "cinder-quobyte-972dbe1d-1cea-438b-9169-8cfc31000c22" by "_copy_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:44 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Volume volume-4dbb9641-16e4-4372-94ed-73a962a1dcde (4dbb9641-16e4-4372-94ed-73a962a1dcde): created successfully Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050e4bfd-b296-43e4-afc0-efe67f0a83fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Flow 'volume_create_manager' (84541b81-fe1f-4aa1-b2f0-36b4e1a65bf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-972dbe1d-1cea-438b-9169-8cfc31000c22" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] snapshot: dd53a52d-7ee7-4fd0-95f9-766c8fa0d468, volume: 972dbe1d-1cea-438b-9169-8cfc31000c22, {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:28:44 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-2a5cf166-5f00-4f50-a385-50cd1ebc61af tempest-GroupsTest-59173743 None] Created volume successfully. Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[034701f6-2a05-4756-b048-4b17a9315729]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:44 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 Aug 05 10:28:44 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:45 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468" returned: 0 in 0.383s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-213ce263-6cab-4611-8a97-2fd732895abc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:28:45 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9fcd6e-fba6-498a-a55c-c466fbba170c]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:45 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-cbeee05b-b4e9-46e1-b35a-8b9b41af83d3 req-9b477fa4-99f0-4275-80a8-faacfd8a1ea0 tempest-ServerActionsTestOtherA-983179334 None] Terminate volume connection completed successfully. Aug 05 10:28:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-cbeee05b-b4e9-46e1-b35a-8b9b41af83d3 req-9b477fa4-99f0-4275-80a8-faacfd8a1ea0 tempest-ServerActionsTestOtherA-983179334 None] Deleting attachment 0f42f623-a86a-4be1-9473-4301472a697d. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:28:45 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc Aug 05 10:28:45 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:45 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc" returned: 0 in 0.484s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] will copy from snapshot at /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:28:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Creating direct copy from snapshot {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:28:45 devstack cinder-volume[88736]: DEBUG cinder.utils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Path /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-972dbe1d-1cea-438b-9169-8cfc31000c22 not found in is_blk_device check {{(pid=88736) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:28:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-972dbe1d-1cea-438b-9169-8cfc31000c22 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:45 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-972dbe1d-1cea-438b-9169-8cfc31000c22 Aug 05 10:28:45 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:47 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:28:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Flow 'volume_create_manager' (f7d757dc-0962-4b11-8195-a035c9ef12d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189650c1-3799-4741-83f1-84543911389b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189650c1-3799-4741-83f1-84543911389b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-979350953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63055427-f27f-46d9-89ba-cf3a55a5ca34,host='devstack@QuobyteHD#QuobyteHD',id=5202fd85-5727-4189-a5df-aea1042ad921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d159ebd75f2f4bb0bc087763e49f6725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:47Z,use_quota=True,user_id='a9b912f551984c2ebf258a16a5ce5eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cac5106f-77f1-4af3-b117-4acc1605b8e2),volume_type_id=cac5106f-77f1-4af3-b117-4acc1605b8e2)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b89738-71b0-49cb-9b6a-30caf59fb287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b89738-71b0-49cb-9b6a-30caf59fb287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee34333-4835-45b1-b667-d560066bf542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee34333-4835-45b1-b667-d560066bf542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5202fd85-5727-4189-a5df-aea1042ad921', 'volume_name': 'volume-5202fd85-5727-4189-a5df-aea1042ad921', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178b649f-f81a-499b-9298-d3096fc47f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178b649f-f81a-499b-9298-d3096fc47f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4909080c-cbdb-4db5-b77b-8fc5843872a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:47 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Volume 5202fd85-5727-4189-a5df-aea1042ad921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5202fd85-5727-4189-a5df-aea1042ad921', 'volume_size': 1} Aug 05 10:28:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:52 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-972dbe1d-1cea-438b-9169-8cfc31000c22" returned: 0 in 7.105s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:52 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Image conversion details: src /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc, size 1024.00 MB, duration 7.11 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-972dbe1d-1cea-438b-9169-8cfc31000c22 {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:28:52 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Converted 1024.00 MB image at 144.10 MB/s Aug 05 10:28:52 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-972dbe1d-1cea-438b-9169-8cfc31000c22 is being set with open permissions: ugo+rw Aug 05 10:28:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-972dbe1d-1cea-438b-9169-8cfc31000c22 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:52 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-972dbe1d-1cea-438b-9169-8cfc31000c22 Aug 05 10:28:52 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:53 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-972dbe1d-1cea-438b-9169-8cfc31000c22" returned: 0 in 0.319s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-972dbe1d-1cea-438b-9169-8cfc31000c22" released by "_copy_volume_from_snapshot" :: held 8.433s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-dd53a52d-7ee7-4fd0-95f9-766c8fa0d468-972dbe1d-1cea-438b-9169-8cfc31000c22" released by "_create_volume_from_snapshot" :: held 8.538s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.573s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.572s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63055427-f27f-46d9-89ba-cf3a55a5ca34,created_at=2026-08-05T08:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-979350953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63055427-f27f-46d9-89ba-cf3a55a5ca34,host='devstack@QuobyteHD#QuobyteHD',id=5202fd85-5727-4189-a5df-aea1042ad921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d159ebd75f2f4bb0bc087763e49f6725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:47Z,use_quota=True,user_id='a9b912f551984c2ebf258a16a5ce5eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cac5106f-77f1-4af3-b117-4acc1605b8e2),volume_type_id=cac5106f-77f1-4af3-b117-4acc1605b8e2)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Creating volume 5202fd85-5727-4189-a5df-aea1042ad921 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:28:53 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5202fd85-5727-4189-a5df-aea1042ad921 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:53 devstack sudo[94739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5202fd85-5727-4189-a5df-aea1042ad921 1073741824 Aug 05 10:28:53 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4e1a1e-c1b0-4f37-80d5-eabcc24e31ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-972dbe1d-1cea-438b-9169-8cfc31000c22', 'volume_size': 1, 'snapshot_id': 'dd53a52d-7ee7-4fd0-95f9-766c8fa0d468'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9b554f-30fe-4e45-a2da-4100286e3833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:53 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Volume volume-972dbe1d-1cea-438b-9169-8cfc31000c22 (972dbe1d-1cea-438b-9169-8cfc31000c22): created successfully Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9b554f-30fe-4e45-a2da-4100286e3833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Flow 'volume_create_manager' (7ccfa8a1-780e-4160-bb22-f7c258b6a165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:53 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-5bece6c7-409f-460d-adf2-fbd2e0192cb2 tempest-VolumesDeleteCascade-399787454 None] Created volume successfully. Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "cinder-213ce263-6cab-4611-8a97-2fd732895abc-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-213ce263-6cab-4611-8a97-2fd732895abc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Performing cascade delete. {{(pid=88736) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "cinder-dd53a52d-7ee7-4fd0-95f9-766c8fa0d468-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:53 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-dd53a52d-7ee7-4fd0-95f9-766c8fa0d468-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5202fd85-5727-4189-a5df-aea1042ad921 1073741824" returned: 0 in 0.578s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "cinder-quobyte-213ce263-6cab-4611-8a97-2fd732895abc" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-213ce263-6cab-4611-8a97-2fd732895abc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "cinder-quobyte-dd53a52d-7ee7-4fd0-95f9-766c8fa0d468" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-dd53a52d-7ee7-4fd0-95f9-766c8fa0d468" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Deleting offline snapshot dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 of volume 213ce263-6cab-4611-8a97-2fd732895abc {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] snapshot_file for this snap is: volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5202fd85-5727-4189-a5df-aea1042ad921 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c66b27a-7931-46ef-9976-e1ab40cdcd0d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:53 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5202fd85-5727-4189-a5df-aea1042ad921 Aug 05 10:28:53 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:54 devstack sudo[94746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 Aug 05 10:28:54 devstack sudo[94746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:54 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5202fd85-5727-4189-a5df-aea1042ad921" returned: 0 in 0.474s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:28:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4909080c-cbdb-4db5-b77b-8fc5843872a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5202fd85-5727-4189-a5df-aea1042ad921', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccaaab1f-770d-469d-9f6e-055ecb2bc88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:54 devstack sudo[94746]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468" returned: 0 in 0.512s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-213ce263-6cab-4611-8a97-2fd732895abc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:28:54 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Volume volume-5202fd85-5727-4189-a5df-aea1042ad921 (5202fd85-5727-4189-a5df-aea1042ad921): created successfully Aug 05 10:28:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccaaab1f-770d-469d-9f6e-055ecb2bc88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Flow 'volume_create_manager' (f7d757dc-0962-4b11-8195-a035c9ef12d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:54 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b76690f-45a7-4a2f-9ac7-8583f2b2b475]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:54 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d8579b05-6947-4afd-b076-018210230faa tempest-GroupsTest-59173743 None] Created volume successfully. Aug 05 10:28:54 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc Aug 05 10:28:54 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:55 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc" returned: 0 in 0.606s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:55 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 Aug 05 10:28:55 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:55 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468" returned: 0 in 0.368s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:55 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468 Aug 05 10:28:55 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:55 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:28:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Flow 'volume_create_manager' (0da18453-2c63-4816-b81d-f6b594cd19bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7290dea-0578-4990-aeab-a01fa04a26ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7290dea-0578-4990-aeab-a01fa04a26ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-995473646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2cfcd3e-467c-474e-bc86-826ca02595be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2a0414367c462a997b57816298cb13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:55Z,use_quota=True,user_id='ff9f10b4586e47b7b52bf539718c147b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da10569a-7292-4315-9260-0a37540f9343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da10569a-7292-4315-9260-0a37540f9343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629571c3-f4f9-45b3-920d-5d4120f7cd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:55 devstack cinder-volume[88736]: DEBUG cinder.image.glance [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Creating Keystone auth plugin from conf {{(pid=88736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:28:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc.dd53a52d-7ee7-4fd0-95f9-766c8fa0d468" returned: 0 in 0.325s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:55 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-dd53a52d-7ee7-4fd0-95f9-766c8fa0d468" released by "_delete_snapshot" :: held 1.993s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-213ce263-6cab-4611-8a97-2fd732895abc" released by "delete_snapshot" :: held 2.021s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:55 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-16e2781e-e5e4-4995-ba7e-7bc7ff3e5dc2 tempest-GroupsTest-59173743 None] Update group completed successfully. Aug 05 10:28:55 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Created reservations ['3e64706d-4e76-4a0b-8dfa-8f64c1911af5', '2953b472-f22c-4c47-bd74-62d01c7803a7', 'e9ae7702-29f1-4ff0-8b23-4d308c0d13e0', '09d27104-56dd-40bc-ae44-1e730144e152'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:28:56 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Delete snapshot completed successfully. Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-dd53a52d-7ee7-4fd0-95f9-766c8fa0d468-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Snapshots deleted, issuing volume delete {{(pid=88736) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "cinder-quobyte-213ce263-6cab-4611-8a97-2fd732895abc" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-213ce263-6cab-4611-8a97-2fd732895abc" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Flow 'volume_create_manager' (df3dfd08-4ee6-40d0-ac6a-718729f9ec3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b041e5-97e2-4e24-8c83-090cf9e8bb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb5911b-f0a7-4839-a40c-a3c84f01988b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b041e5-97e2-4e24-8c83-090cf9e8bb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-173391233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13f2c1d-f9bf-4d5f-a029-c88e9afae623,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='378d73d09bb447068a6c4135906b0020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:56Z,use_quota=True,user_id='5accdf5de2ac43a3b49c5e3d9c7ffefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14ad62d-4b27-4fd7-9429-85bfa275e394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14ad62d-4b27-4fd7-9429-85bfa275e394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624483b5-71cd-478d-a514-182e812e1ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624483b5-71cd-478d-a514-182e812e1ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b13f2c1d-f9bf-4d5f-a029-c88e9afae623', 'volume_name': 'volume-b13f2c1d-f9bf-4d5f-a029-c88e9afae623', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c77d37a-0e67-47f5-b2d2-dfabc44f3fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c77d37a-0e67-47f5-b2d2-dfabc44f3fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7ea1a6-4717-4250-b2d5-9f52d4e0d052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:56 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Volume b13f2c1d-f9bf-4d5f-a029-c88e9afae623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b13f2c1d-f9bf-4d5f-a029-c88e9afae623', 'volume_size': 1} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-173391233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13f2c1d-f9bf-4d5f-a029-c88e9afae623,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='378d73d09bb447068a6c4135906b0020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:56Z,use_quota=True,user_id='5accdf5de2ac43a3b49c5e3d9c7ffefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Creating volume b13f2c1d-f9bf-4d5f-a029-c88e9afae623 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:28:56 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b13f2c1d-f9bf-4d5f-a029-c88e9afae623 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:56 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b13f2c1d-f9bf-4d5f-a029-c88e9afae623 1073741824 Aug 05 10:28:56 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:56 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc Aug 05 10:28:56 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629571c3-f4f9-45b3-920d-5d4120f7cd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b2cfcd3e-467c-474e-bc86-826ca02595be', 'volume_name': 'volume-b2cfcd3e-467c-474e-bc86-826ca02595be', 'volume_size': 1, 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73179855073b4e3ea3fba8cb6e296bd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/619f1530-41da-4b56-a554-65c809c7c1ea/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f12e8fb-4a33-4575-a25c-b90a3a6a8180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f12e8fb-4a33-4575-a25c-b90a3a6a8180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4766133-26b7-4ab1-adef-b5e365ce07b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:56 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Volume b2cfcd3e-467c-474e-bc86-826ca02595be: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b2cfcd3e-467c-474e-bc86-826ca02595be', 'volume_size': 1, 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73179855073b4e3ea3fba8cb6e296bd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/619f1530-41da-4b56-a554-65c809c7c1ea/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Trying to clone b2cfcd3e-467c-474e-bc86-826ca02595be from image 619f1530-41da-4b56-a554-65c809c7c1ea at location (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]). {{(pid=88736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:28:56 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc" returned: 0 in 0.473s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:56 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc Aug 05 10:28:56 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_bynx4xtndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:28:56 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Image download 20.69 MB at 20.69 MB/s Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acd57fe-2f49-4309-98d4-443f9031342f]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_bynx4xtndevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:56 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b13f2c1d-f9bf-4d5f-a029-c88e9afae623 1073741824" returned: 0 in 0.527s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b13f2c1d-f9bf-4d5f-a029-c88e9afae623 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:56 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b13f2c1d-f9bf-4d5f-a029-c88e9afae623 Aug 05 10:28:56 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:56 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_bynx4xtndevstack@QuobyteHD Aug 05 10:28:56 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:56 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-213ce263-6cab-4611-8a97-2fd732895abc" returned: 0 in 0.283s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-213ce263-6cab-4611-8a97-2fd732895abc" released by "delete_volume" :: held 0.851s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Created reservations ['a68702ba-3cef-4739-b987-4adfe7831802', '7e1c7908-21e9-4bde-ba45-02f91707f954', '81c5ef5e-1baa-466f-83bf-ecf0fe12eff6', 'f77a26db-db40-42f9-bab6-a28ba3ce129a'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:57 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b13f2c1d-f9bf-4d5f-a029-c88e9afae623" returned: 0 in 0.337s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:57 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:28:57 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7ea1a6-4717-4250-b2d5-9f52d4e0d052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b13f2c1d-f9bf-4d5f-a029-c88e9afae623', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b78238c-9d97-4321-8d0a-c38054e9b8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:57 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Volume volume-b13f2c1d-f9bf-4d5f-a029-c88e9afae623 (b13f2c1d-f9bf-4d5f-a029-c88e9afae623): created successfully Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b78238c-9d97-4321-8d0a-c38054e9b8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:57 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Flow 'volume_create_manager' (df3dfd08-4ee6-40d0-ac6a-718729f9ec3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_bynx4xtndevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Temporary image 619f1530-41da-4b56-a554-65c809c7c1ea is fetched for user ff9f10b4586e47b7b52bf539718c147b. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:28:57 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7ce39ce9-768f-4b5d-b0f8-7407e991d026 tempest-VolumesTestJSON-2118440242 None] Created volume successfully. Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb1d2c1-9f18-496f-b02a-7b2291b3ad05]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_bynx4xtndevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:57 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-40760fa4-3501-4359-b186-6afb20d53dd0 tempest-GroupsTest-59173743 None] Update group completed successfully. Aug 05 10:28:57 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.322s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:28:57 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_bynx4xtndevstack@QuobyteHD Aug 05 10:28:57 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:57 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Deleted volume successfully. Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97b0c20d-bf84-493c-a9b3-80cd5413228f tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-213ce263-6cab-4611-8a97-2fd732895abc-delete_volume" released by "delete_volume" :: held 3.718s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:57 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_bynx4xtndevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-995473646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2cfcd3e-467c-474e-bc86-826ca02595be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2a0414367c462a997b57816298cb13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:55Z,use_quota=True,user_id='ff9f10b4586e47b7b52bf539718c147b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Creating volume b2cfcd3e-467c-474e-bc86-826ca02595be {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:28:57 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:28:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:57 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be 1073741824 Aug 05 10:28:57 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:58 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be 1073741824" returned: 0 in 0.400s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:58 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be Aug 05 10:28:58 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "cinder-972dbe1d-1cea-438b-9169-8cfc31000c22-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-972dbe1d-1cea-438b-9169-8cfc31000c22-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:58 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be" returned: 0 in 0.285s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "cinder-quobyte-972dbe1d-1cea-438b-9169-8cfc31000c22" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-972dbe1d-1cea-438b-9169-8cfc31000c22" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Attempting download of 619f1530-41da-4b56-a554-65c809c7c1ea ((None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}])) to volume b2cfcd3e-467c-474e-bc86-826ca02595be. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3852ca97-16a8-49a8-8fc3-eee0fb8c5853]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-972dbe1d-1cea-438b-9169-8cfc31000c22 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cc0e2c-b3a1-4500-a32b-caa8bc134ede]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_gpix8aw8 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:58 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-972dbe1d-1cea-438b-9169-8cfc31000c22 Aug 05 10:28:58 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:58 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_gpix8aw8 Aug 05 10:28:58 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Flow 'volume_create_manager' (d9fddfe0-f70b-4cc7-94c8-c1866872de1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bab85a-b314-40ea-aa8c-92d5dea34195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bab85a-b314-40ea-aa8c-92d5dea34195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-647596656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc23918e-f126-47c5-a668-78f8b7335a34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='378d73d09bb447068a6c4135906b0020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:59Z,use_quota=True,user_id='5accdf5de2ac43a3b49c5e3d9c7ffefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7a508a-ab36-4b8a-a66a-dec8b2363a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7a508a-ab36-4b8a-a66a-dec8b2363a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fdfe771-1a59-4f50-80fb-3e5374aabef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fdfe771-1a59-4f50-80fb-3e5374aabef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc23918e-f126-47c5-a668-78f8b7335a34', 'volume_name': 'volume-fc23918e-f126-47c5-a668-78f8b7335a34', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897ce123-ea2c-43f9-9288-cfaeb5f7a7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897ce123-ea2c-43f9-9288-cfaeb5f7a7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd308bde-26ac-4727-84e1-8dd203c88701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:58 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Volume fc23918e-f126-47c5-a668-78f8b7335a34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc23918e-f126-47c5-a668-78f8b7335a34', 'volume_size': 1} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-647596656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc23918e-f126-47c5-a668-78f8b7335a34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='378d73d09bb447068a6c4135906b0020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:28:59Z,use_quota=True,user_id='5accdf5de2ac43a3b49c5e3d9c7ffefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Creating volume fc23918e-f126-47c5-a668-78f8b7335a34 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:28:58 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fc23918e-f126-47c5-a668-78f8b7335a34 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:58 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fc23918e-f126-47c5-a668-78f8b7335a34 1073741824 Aug 05 10:28:58 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:58 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-972dbe1d-1cea-438b-9169-8cfc31000c22" returned: 0 in 0.499s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-972dbe1d-1cea-438b-9169-8cfc31000c22 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:58 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_gpix8aw8" returned: 0 in 0.453s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_gpix8aw8 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:58 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-972dbe1d-1cea-438b-9169-8cfc31000c22 Aug 05 10:28:58 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:59 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_gpix8aw8 Aug 05 10:28:59 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Acquiring lock "cinder-quobyte-4dbb9641-16e4-4372-94ed-73a962a1dcde" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Lock "cinder-quobyte-4dbb9641-16e4-4372-94ed-73a962a1dcde" acquired by "delete_volume" :: waited 0.026s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[374fc4c6-0d6a-47d7-af2c-f804e558c670]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4dbb9641-16e4-4372-94ed-73a962a1dcde {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:59 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-972dbe1d-1cea-438b-9169-8cfc31000c22" returned: 0 in 0.321s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-quobyte-972dbe1d-1cea-438b-9169-8cfc31000c22" released by "delete_volume" :: held 0.877s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] Created reservations ['e051d989-c0c7-48e8-9485-88d0b4f26510', '919b2103-14cf-40b2-96b9-f52f63838cd3', 'be4b3d1d-40cd-4dab-9653-bff6d73d8d16', '5bb3396d-aab9-477d-91a4-9523da6bf99e'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:28:59 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4dbb9641-16e4-4372-94ed-73a962a1dcde Aug 05 10:28:59 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:59 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_gpix8aw8" returned: 1 in 0.461s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_gpix8aw8' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e40b30-3b63-474b-a078-d6b238c27fe2]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_bynx4xtndevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:59 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fc23918e-f126-47c5-a668-78f8b7335a34 1073741824" returned: 0 in 0.618s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fc23918e-f126-47c5-a668-78f8b7335a34 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:59 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:28:59 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:59 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fc23918e-f126-47c5-a668-78f8b7335a34 Aug 05 10:28:59 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:59 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_bynx4xtndevstack@QuobyteHD Aug 05 10:28:59 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:59 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4dbb9641-16e4-4372-94ed-73a962a1dcde" returned: 0 in 0.566s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4dbb9641-16e4-4372-94ed-73a962a1dcde {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:59 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4dbb9641-16e4-4372-94ed-73a962a1dcde Aug 05 10:28:59 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:28:59 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fc23918e-f126-47c5-a668-78f8b7335a34" returned: 0 in 0.370s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:28:59 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.428s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd308bde-26ac-4727-84e1-8dd203c88701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc23918e-f126-47c5-a668-78f8b7335a34', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:28:59 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fff406-9b2f-4c1b-ac30-4c7997d7dd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_bynx4xtndevstack@QuobyteHD" returned: 0 in 0.502s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:28:59 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] Deleted volume successfully. Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] 619f1530-41da-4b56-a554-65c809c7c1ea was qcow2, converting to qcow2 {{(pid=88736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:28:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_bynx4xtndevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:28:59 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Volume volume-fc23918e-f126-47c5-a668-78f8b7335a34 (fc23918e-f126-47c5-a668-78f8b7335a34): created successfully Aug 05 10:28:59 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_bynx4xtndevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be Aug 05 10:28:59 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fff406-9b2f-4c1b-ac30-4c7997d7dd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Flow 'volume_create_manager' (d9fddfe0-f70b-4cc7-94c8-c1866872de1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:00 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8289793d-bc12-438e-bf93-7fbe14b94973 tempest-VolumesDeleteCascade-399787454 None] Lock "cinder-972dbe1d-1cea-438b-9169-8cfc31000c22-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:00 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-bc3aae2f-dea0-4783-9553-e3e80f9aae0f tempest-VolumesTestJSON-2118440242 None] Created volume successfully. Aug 05 10:29:00 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4dbb9641-16e4-4372-94ed-73a962a1dcde" returned: 0 in 0.301s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:00 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Lock "cinder-quobyte-4dbb9641-16e4-4372-94ed-73a962a1dcde" released by "delete_volume" :: held 0.919s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:00 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Acquiring lock "cinder-quobyte-5202fd85-5727-4189-a5df-aea1042ad921" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:00 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Lock "cinder-quobyte-5202fd85-5727-4189-a5df-aea1042ad921" acquired by "delete_volume" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:00 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2e4870-6d0c-4738-9b14-a172511a3837]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5202fd85-5727-4189-a5df-aea1042ad921 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:00 devstack sudo[94884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5202fd85-5727-4189-a5df-aea1042ad921 Aug 05 10:29:00 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:00 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5202fd85-5727-4189-a5df-aea1042ad921" returned: 0 in 0.458s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5202fd85-5727-4189-a5df-aea1042ad921 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:00 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5202fd85-5727-4189-a5df-aea1042ad921 Aug 05 10:29:00 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:00 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5202fd85-5727-4189-a5df-aea1042ad921" returned: 0 in 0.332s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Lock "cinder-quobyte-5202fd85-5727-4189-a5df-aea1042ad921" released by "delete_volume" :: held 0.853s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Created reservations ['8cbdcfab-0bc0-41b0-9335-5ba7cbec965e'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:01 devstack cinder-volume[88736]: WARNING cinder.quota [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-606583419 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-606583419, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:29:01 devstack cinder-volume[88736]: WARNING cinder.quota [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-606583419 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-606583419, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Created reservations ['1ac8f364-8b20-49ef-81c0-e5f648a32c80', '1613e1f2-e983-4dab-8001-19a09dc11d1d', '4c805e67-0c33-4cf2-a625-b0c42ba9355c', 'c98950b1-ce53-40be-90fa-db4192721f0d'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Created reservations ['d7cae2f5-2b46-43b4-8569-b0a29a81a065', '2ba77429-f3d2-48ee-929b-7f66f3a14e4d', '6cff0cc4-79fb-4060-b125-dde01d494cdd', 'edf3ec9c-2684-4d17-ad99-da7d72322d61'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:01 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:29:01 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Flow 'volume_create_manager' (14e9e2c8-7ad2-4fab-a87a-501641641115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99bec74-d5b2-4ea9-9167-6e6c63508424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99bec74-d5b2-4ea9-9167-6e6c63508424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-301110382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b000c860-5f78-44d5-ab2d-c9deb7d9ae1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='378d73d09bb447068a6c4135906b0020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:02Z,use_quota=True,user_id='5accdf5de2ac43a3b49c5e3d9c7ffefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3b8c03-0276-4d62-a6f5-52448d020562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3b8c03-0276-4d62-a6f5-52448d020562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b4861f-40b4-40ea-b6bf-90d5b5ec528b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b4861f-40b4-40ea-b6bf-90d5b5ec528b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b000c860-5f78-44d5-ab2d-c9deb7d9ae1f', 'volume_name': 'volume-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7bb420-eefb-4a18-b047-7cbdf6fa43d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7bb420-eefb-4a18-b047-7cbdf6fa43d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5621cd9-43f7-4654-86d6-785e11238edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:01 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Volume b000c860-5f78-44d5-ab2d-c9deb7d9ae1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f', 'volume_size': 1} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-301110382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b000c860-5f78-44d5-ab2d-c9deb7d9ae1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='378d73d09bb447068a6c4135906b0020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:02Z,use_quota=True,user_id='5accdf5de2ac43a3b49c5e3d9c7ffefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Creating volume b000c860-5f78-44d5-ab2d-c9deb7d9ae1f {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:01 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:01 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.362s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:01 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:01 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d4d654ac-8423-4d4e-b091-3c57ce76af4b tempest-GroupsTest-59173743 None] Delete group completed successfully. Aug 05 10:29:01 devstack sudo[94900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f 1073741824 Aug 05 10:29:01 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:02 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_bynx4xtndevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be" returned: 0 in 2.328s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_bynx4xtndevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:29:02 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Converted 112.00 MB image at 48.09 MB/s Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:02 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be 1G Aug 05 10:29:02 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:02 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f 1073741824" returned: 0 in 0.655s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:02 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f Aug 05 10:29:02 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:02 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be 1G" returned: 0 in 0.464s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Downloaded image 619f1530-41da-4b56-a554-65c809c7c1ea ((None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}])) to volume b2cfcd3e-467c-474e-bc86-826ca02595be successfully. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Temporary image 619f1530-41da-4b56-a554-65c809c7c1ea for user ff9f10b4586e47b7b52bf539718c147b is deleted. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Marking volume b2cfcd3e-467c-474e-bc86-826ca02595be as bootable. {{(pid=88736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Copying metadata from image 619f1530-41da-4b56-a554-65c809c7c1ea to b2cfcd3e-467c-474e-bc86-826ca02595be. {{(pid=88736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Creating volume glance metadata for volume b2cfcd3e-467c-474e-bc86-826ca02595be backed by image 619f1530-41da-4b56-a554-65c809c7c1ea with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4766133-26b7-4ab1-adef-b5e365ce07b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2cfcd3e-467c-474e-bc86-826ca02595be', 'volume_size': 1, 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73179855073b4e3ea3fba8cb6e296bd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/619f1530-41da-4b56-a554-65c809c7c1ea/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4907a516-a05e-443a-8843-732ad27a6a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:02 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f" returned: 0 in 0.288s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:02 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Volume volume-b2cfcd3e-467c-474e-bc86-826ca02595be (b2cfcd3e-467c-474e-bc86-826ca02595be): created successfully Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4907a516-a05e-443a-8843-732ad27a6a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Flow 'volume_create_manager' (0da18453-2c63-4816-b81d-f6b594cd19bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5621cd9-43f7-4654-86d6-785e11238edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5759491-7535-43a0-8fa5-1ffcb9035e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:02 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ae475aef-9ebc-426a-9cfc-cc0b35ef237a tempest-ServerActionsTestOtherA-983179334 None] Created volume successfully. Aug 05 10:29:02 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Volume volume-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f (b000c860-5f78-44d5-ab2d-c9deb7d9ae1f): created successfully Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5759491-7535-43a0-8fa5-1ffcb9035e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Flow 'volume_create_manager' (14e9e2c8-7ad2-4fab-a87a-501641641115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:02 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d0a9a04a-bf70-4b67-b1df-b9a11fd47b9f tempest-VolumesTestJSON-2118440242 None] Created volume successfully. Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Flow 'volume_create_manager' (a06882c9-2f20-4ca1-9d93-3814eac2fcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0892411f-e754-40f0-b082-d28c2572da5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0892411f-e754-40f0-b082-d28c2572da5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2118630683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403f85c9-7740-4017-b2f5-635c6e3394af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a9cd5a6e914dcf8947753b48e93ab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:04Z,use_quota=True,user_id='3092429665eb43da97ea4129cf39bfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b968a2a-6c2a-406e-9e40-c73c5010a4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b968a2a-6c2a-406e-9e40-c73c5010a4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73412ed3-bff6-4a1b-bfbf-95a2b6ac0383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73412ed3-bff6-4a1b-bfbf-95a2b6ac0383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '403f85c9-7740-4017-b2f5-635c6e3394af', 'volume_name': 'volume-403f85c9-7740-4017-b2f5-635c6e3394af', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967f3fea-0c13-4559-9abb-0de7ad13cb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967f3fea-0c13-4559-9abb-0de7ad13cb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338796a1-6ac1-4500-80b8-dcf1897c4174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:03 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Volume 403f85c9-7740-4017-b2f5-635c6e3394af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-403f85c9-7740-4017-b2f5-635c6e3394af', 'volume_size': 1} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2118630683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403f85c9-7740-4017-b2f5-635c6e3394af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a9cd5a6e914dcf8947753b48e93ab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:04Z,use_quota=True,user_id='3092429665eb43da97ea4129cf39bfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Creating volume 403f85c9-7740-4017-b2f5-635c6e3394af {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:03 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:29:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-403f85c9-7740-4017-b2f5-635c6e3394af 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:03 devstack sudo[94915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-403f85c9-7740-4017-b2f5-635c6e3394af 1073741824 Aug 05 10:29:03 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:04 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-403f85c9-7740-4017-b2f5-635c6e3394af 1073741824" returned: 0 in 0.592s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-403f85c9-7740-4017-b2f5-635c6e3394af {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:04 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-403f85c9-7740-4017-b2f5-635c6e3394af Aug 05 10:29:04 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:04 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-403f85c9-7740-4017-b2f5-635c6e3394af" returned: 0 in 0.402s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338796a1-6ac1-4500-80b8-dcf1897c4174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-403f85c9-7740-4017-b2f5-635c6e3394af', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0bf4dc-c951-4b29-8299-56ed978205c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:04 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Volume volume-403f85c9-7740-4017-b2f5-635c6e3394af (403f85c9-7740-4017-b2f5-635c6e3394af): created successfully Aug 05 10:29:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0bf4dc-c951-4b29-8299-56ed978205c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Flow 'volume_create_manager' (a06882c9-2f20-4ca1-9d93-3814eac2fcf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:05 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1dba5355-03a8-496d-b830-6d3e7503f851 tempest-VolumesMetadataTest-1149106216 None] Created volume successfully. Aug 05 10:29:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] Acquiring lock "cinder-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] Lock "cinder-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] Acquiring lock "cinder-quobyte-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] Lock "cinder-quobyte-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f" acquired by "delete_volume" :: waited 0.029s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:05 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c09656-3828-4945-8b48-b53599e519fc]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:05 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f Aug 05 10:29:05 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:05 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f" returned: 0 in 0.416s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:05 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f Aug 05 10:29:05 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:05 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f" returned: 0 in 0.342s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] Lock "cinder-quobyte-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f" released by "delete_volume" :: held 0.811s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:06 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] Created reservations ['e5d831cb-0a55-4453-bfa6-f8f8c7779508', '8fb1a9ec-6e21-494b-98e8-15a18e4aeff6', '0da7da58-2a2b-4712-b6fb-9eb165755354', 'cbeb9988-21e4-4149-a883-c61afb12eb3b'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:06 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:29:06 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] Acquiring lock "cinder-fc23918e-f126-47c5-a668-78f8b7335a34-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] Lock "cinder-fc23918e-f126-47c5-a668-78f8b7335a34-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] Acquiring lock "cinder-quobyte-fc23918e-f126-47c5-a668-78f8b7335a34" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] Lock "cinder-quobyte-fc23918e-f126-47c5-a668-78f8b7335a34" acquired by "delete_volume" :: waited 0.027s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:06 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bdaf7c-fbec-49fc-92fc-e8040d0d1457]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fc23918e-f126-47c5-a668-78f8b7335a34 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:06 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.556s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:06 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:06 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fc23918e-f126-47c5-a668-78f8b7335a34 Aug 05 10:29:06 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:06 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] Deleted volume successfully. Aug 05 10:29:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-41c8c791-b996-4cf0-b978-ed43612a5878 tempest-VolumesTestJSON-2118440242 None] Lock "cinder-b000c860-5f78-44d5-ab2d-c9deb7d9ae1f-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:07 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] Acquiring lock "cinder-403f85c9-7740-4017-b2f5-635c6e3394af-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=174,cinder:UPDATE=173,cinder:INSERT=46,cinder:DELETE=12 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fc23918e-f126-47c5-a668-78f8b7335a34" returned: 0 in 0.671s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fc23918e-f126-47c5-a668-78f8b7335a34 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:07 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fc23918e-f126-47c5-a668-78f8b7335a34 Aug 05 10:29:07 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-27a3745e-0c9f-4d0c-be96-b91c7e3d3988 req-8462a6ff-eb69-4066-91e9-3cddb9eea2ee tempest-ServerActionsTestOtherA-983179334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-27a3745e-0c9f-4d0c-be96-b91c7e3d3988 req-8462a6ff-eb69-4066-91e9-3cddb9eea2ee tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] Lock "cinder-403f85c9-7740-4017-b2f5-635c6e3394af-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:UPDATE=160,cinder:SELECT=147,cinder:INSERT=41,cinder:DELETE=12 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-27a3745e-0c9f-4d0c-be96-b91c7e3d3988 req-8462a6ff-eb69-4066-91e9-3cddb9eea2ee tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.101s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] Acquiring lock "cinder-quobyte-403f85c9-7740-4017-b2f5-635c6e3394af" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-27a3745e-0c9f-4d0c-be96-b91c7e3d3988 req-8462a6ff-eb69-4066-91e9-3cddb9eea2ee tempest-ServerActionsTestOtherA-983179334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-b2cfcd3e-467c-474e-bc86-826ca02595be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac7d96ee-194f-43fd-9805-f29f5aa3fbb1', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] Lock "cinder-quobyte-403f85c9-7740-4017-b2f5-635c6e3394af" acquired by "delete_volume" :: waited 0.037s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3234e1-1371-4205-9ea0-840ae6eb1d74]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-403f85c9-7740-4017-b2f5-635c6e3394af {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:07 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-27a3745e-0c9f-4d0c-be96-b91c7e3d3988 req-8462a6ff-eb69-4066-91e9-3cddb9eea2ee tempest-ServerActionsTestOtherA-983179334 None] attachment_update completed successfully. Aug 05 10:29:07 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fc23918e-f126-47c5-a668-78f8b7335a34" returned: 0 in 0.459s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] Lock "cinder-quobyte-fc23918e-f126-47c5-a668-78f8b7335a34" released by "delete_volume" :: held 1.219s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:07 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-403f85c9-7740-4017-b2f5-635c6e3394af Aug 05 10:29:07 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] Created reservations ['20d8800a-47bb-45c5-8b48-78e421bc1946', '49892409-7786-463a-9dd8-016ba5957141', '082128fd-002f-44eb-84c1-8dbbcd6b279f', 'b426adbe-1344-4d06-98e5-5e6c8ae6c0f0'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:08 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:29:08 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:08 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-403f85c9-7740-4017-b2f5-635c6e3394af" returned: 0 in 0.734s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-403f85c9-7740-4017-b2f5-635c6e3394af {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:08 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-403f85c9-7740-4017-b2f5-635c6e3394af Aug 05 10:29:08 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:08 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.430s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:08 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] Deleted volume successfully. Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-56690e5a-82df-48d3-bc5a-675f7f0f2586 tempest-VolumesTestJSON-2118440242 None] Lock "cinder-fc23918e-f126-47c5-a668-78f8b7335a34-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:08 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-403f85c9-7740-4017-b2f5-635c6e3394af" returned: 0 in 0.342s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] Lock "cinder-quobyte-403f85c9-7740-4017-b2f5-635c6e3394af" released by "delete_volume" :: held 1.151s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] Created reservations ['a18d44b1-adb3-435a-a272-ac455d1ee03a', 'ac20955f-4eeb-456e-9ba8-760f38a6f1e7', '0d6aefa5-db58-4396-97a6-5e06885d9dfb', '728eacc5-a5b9-49ea-ac3a-57891261f5eb'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:08 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:29:08 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] Acquiring lock "cinder-b13f2c1d-f9bf-4d5f-a029-c88e9afae623-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] Lock "cinder-b13f2c1d-f9bf-4d5f-a029-c88e9afae623-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] Acquiring lock "cinder-quobyte-b13f2c1d-f9bf-4d5f-a029-c88e9afae623" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] Lock "cinder-quobyte-b13f2c1d-f9bf-4d5f-a029-c88e9afae623" acquired by "delete_volume" :: waited 0.024s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:09 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a2ab5b-2ea2-4763-a0b5-8fd9d6b9c2f4]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b13f2c1d-f9bf-4d5f-a029-c88e9afae623 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:09 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.331s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:09 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:09 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] Deleted volume successfully. Aug 05 10:29:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4178b5b9-49ba-4900-9786-f6b0f565ba5a tempest-VolumesMetadataTest-1149106216 None] Lock "cinder-403f85c9-7740-4017-b2f5-635c6e3394af-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:09 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b13f2c1d-f9bf-4d5f-a029-c88e9afae623 Aug 05 10:29:09 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:09 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b13f2c1d-f9bf-4d5f-a029-c88e9afae623" returned: 0 in 0.482s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b13f2c1d-f9bf-4d5f-a029-c88e9afae623 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:09 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b13f2c1d-f9bf-4d5f-a029-c88e9afae623 Aug 05 10:29:09 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:09 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b13f2c1d-f9bf-4d5f-a029-c88e9afae623" returned: 0 in 0.353s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] Lock "cinder-quobyte-b13f2c1d-f9bf-4d5f-a029-c88e9afae623" released by "delete_volume" :: held 0.904s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:09 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] Created reservations ['9da7a609-bdfa-4052-a6fd-1fc1d613894b', 'bc0f0bba-1aca-4c28-ab8c-5c136d89af97', 'af058b13-831e-4e3f-9b62-9fdf5fd98b19', '044b7ef4-a3b6-4779-9790-e13d72e973c6'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:10 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:29:10 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:10 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.579s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:10 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:10 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] Deleted volume successfully. Aug 05 10:29:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-dda98560-4310-4dc7-bf85-4a1471deb942 tempest-VolumesTestJSON-2118440242 None] Lock "cinder-b13f2c1d-f9bf-4d5f-a029-c88e9afae623-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:29:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:13 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:29:13 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:14 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.343s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:29:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:29:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Flow 'volume_create_manager' (099b7948-8c39-40df-bd1d-2955706ddd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57cc5200-cf4f-45c9-b021-eb121a8c1a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57cc5200-cf4f-45c9-b021-eb121a8c1a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-694353535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646f175a-97b6-421d-a583-5b222911cfb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f0d4f7bb5fd4832be8d9535d73cb1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:19Z,use_quota=True,user_id='13642177b5c04a56a457c53c4b0fa5f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c4dca8-4ab2-4499-85b7-a0b32b3e796d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c4dca8-4ab2-4499-85b7-a0b32b3e796d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1c3074-072f-46fe-a14c-6156a2715453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1c3074-072f-46fe-a14c-6156a2715453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '646f175a-97b6-421d-a583-5b222911cfb9', 'volume_name': 'volume-646f175a-97b6-421d-a583-5b222911cfb9', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12b9948-dd76-4501-be1d-76b3bd76462d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12b9948-dd76-4501-be1d-76b3bd76462d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0ee63a-1086-4f29-b269-516335dea7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:19 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Volume 646f175a-97b6-421d-a583-5b222911cfb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-646f175a-97b6-421d-a583-5b222911cfb9', 'volume_size': 1} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-694353535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646f175a-97b6-421d-a583-5b222911cfb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f0d4f7bb5fd4832be8d9535d73cb1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:19Z,use_quota=True,user_id='13642177b5c04a56a457c53c4b0fa5f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Creating volume 646f175a-97b6-421d-a583-5b222911cfb9 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:19 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:29:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-646f175a-97b6-421d-a583-5b222911cfb9 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:19 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-aa43673e-a36a-4503-9af5-1a1ad18a63c9 tempest-GroupSnapshotsTest-1753681046 None] Group tempest-GroupSnapshotsTest-Group-524580730: creating Aug 05 10:29:19 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-646f175a-97b6-421d-a583-5b222911cfb9 1073741824 Aug 05 10:29:19 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:19 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-aa43673e-a36a-4503-9af5-1a1ad18a63c9 tempest-GroupSnapshotsTest-1753681046 None] Group tempest-GroupSnapshotsTest-Group-524580730: created successfully Aug 05 10:29:19 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-aa43673e-a36a-4503-9af5-1a1ad18a63c9 tempest-GroupSnapshotsTest-1753681046 None] Create group completed successfully. Aug 05 10:29:20 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-646f175a-97b6-421d-a583-5b222911cfb9 1073741824" returned: 0 in 0.814s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-646f175a-97b6-421d-a583-5b222911cfb9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:20 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-646f175a-97b6-421d-a583-5b222911cfb9 Aug 05 10:29:20 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:21 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-646f175a-97b6-421d-a583-5b222911cfb9" returned: 0 in 0.658s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0ee63a-1086-4f29-b269-516335dea7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646f175a-97b6-421d-a583-5b222911cfb9', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45aeeb32-ea10-4c3b-8355-336793bbee39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:21 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Volume volume-646f175a-97b6-421d-a583-5b222911cfb9 (646f175a-97b6-421d-a583-5b222911cfb9): created successfully Aug 05 10:29:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45aeeb32-ea10-4c3b-8355-336793bbee39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Flow 'volume_create_manager' (099b7948-8c39-40df-bd1d-2955706ddd69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:21 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1ec57d63-ea9e-4236-b5a4-aa69aabcf96d tempest-VolumesTransfersV357Test-386764055 None] Created volume successfully. Aug 05 10:29:21 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Flow 'volume_create_manager' (c792fbeb-13ff-4e60-94e3-6558ccdfbf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea8b5e6-cd74-4cb5-ae2c-698f49e30536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea8b5e6-cd74-4cb5-ae2c-698f49e30536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-466974602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be7f7e08-0f0d-4956-8047-8a343fa6e3b9,host='devstack@QuobyteHD#QuobyteHD',id=35cd6f9d-795d-421f-9262-8b59c3ef23b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5faedda4ed74ed2a21252af374d1296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:22Z,use_quota=True,user_id='2a11aac3337445aeafd061523963668e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c81db2c-f839-4a40-a09a-50a1f0afb663),volume_type_id=2c81db2c-f839-4a40-a09a-50a1f0afb663)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f524a7c0-f231-4631-afe6-5738625404cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f524a7c0-f231-4631-afe6-5738625404cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656acb9e-feec-46bd-b7ca-59bf1224354d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656acb9e-feec-46bd-b7ca-59bf1224354d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35cd6f9d-795d-421f-9262-8b59c3ef23b4', 'volume_name': 'volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef714e6-a07b-40f3-a0d9-161c1b1d05fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef714e6-a07b-40f3-a0d9-161c1b1d05fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5f382e-f6ac-4b36-98f6-0b99c9cb297d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:22 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Volume 35cd6f9d-795d-421f-9262-8b59c3ef23b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4', 'volume_size': 1} Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=be7f7e08-0f0d-4956-8047-8a343fa6e3b9,created_at=2026-08-05T08:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-466974602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be7f7e08-0f0d-4956-8047-8a343fa6e3b9,host='devstack@QuobyteHD#QuobyteHD',id=35cd6f9d-795d-421f-9262-8b59c3ef23b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5faedda4ed74ed2a21252af374d1296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:22Z,use_quota=True,user_id='2a11aac3337445aeafd061523963668e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c81db2c-f839-4a40-a09a-50a1f0afb663),volume_type_id=2c81db2c-f839-4a40-a09a-50a1f0afb663)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Creating volume 35cd6f9d-795d-421f-9262-8b59c3ef23b4 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:22 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:22 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 1073741824 Aug 05 10:29:22 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:22 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 1073741824" returned: 0 in 0.825s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:23 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 Aug 05 10:29:23 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:23 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4" returned: 0 in 0.682s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5f382e-f6ac-4b36-98f6-0b99c9cb297d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62ae75e-1153-4b43-b34b-a1e9acac68c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:23 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Volume volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 (35cd6f9d-795d-421f-9262-8b59c3ef23b4): created successfully Aug 05 10:29:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62ae75e-1153-4b43-b34b-a1e9acac68c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Flow 'volume_create_manager' (c792fbeb-13ff-4e60-94e3-6558ccdfbf31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:23 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e23653ee-0951-40f2-896b-74307e0a664b tempest-GroupSnapshotsTest-1753681046 None] Created volume successfully. Aug 05 10:29:24 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-2c7b6b15-d5f7-46d1-91ab-af4e61e0a36d tempest-VolumesTransfersV357Test-576031959 None] Transfer volume completed successfully. Aug 05 10:29:25 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] GroupSnapshot 82e036ac-d7bb-4502-a91a-afb7df8e42e0: creating. Aug 05 10:29:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] Group snapshot 82e036ac-d7bb-4502-a91a-afb7df8e42e0: creating. {{(pid=88736) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 10:29:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] Creating offline snapshot 448e3bb0-8741-435a-8ae9-ece5b9cf75ae of volume 35cd6f9d-795d-421f-9262-8b59c3ef23b4 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:29:25 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1621a0-6b90-4199-97f5-a29b24305abc]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:25 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 Aug 05 10:29:25 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] Acquiring lock "cinder-646f175a-97b6-421d-a583-5b222911cfb9-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] Lock "cinder-646f175a-97b6-421d-a583-5b222911cfb9-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] Acquiring lock "cinder-quobyte-646f175a-97b6-421d-a583-5b222911cfb9" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] Lock "cinder-quobyte-646f175a-97b6-421d-a583-5b222911cfb9" acquired by "delete_volume" :: waited 0.024s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:25 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9479579-5ad2-4b3d-b0af-d60e9b08fcba]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-646f175a-97b6-421d-a583-5b222911cfb9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:25 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4" returned: 0 in 0.733s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:25 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae 1G Aug 05 10:29:25 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:25 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-60d9ff07-b262-4dbb-a8f5-bbe7e2e7f194 req-8ab327e4-55fe-4f40-8996-a60aea6203fe tempest-ServerActionsTestOtherA-983179334 None] Terminate volume connection completed successfully. Aug 05 10:29:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-60d9ff07-b262-4dbb-a8f5-bbe7e2e7f194 req-8ab327e4-55fe-4f40-8996-a60aea6203fe tempest-ServerActionsTestOtherA-983179334 None] Deleting attachment ac7d96ee-194f-43fd-9805-f29f5aa3fbb1. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:29:25 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-646f175a-97b6-421d-a583-5b222911cfb9 Aug 05 10:29:25 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:26 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-646f175a-97b6-421d-a583-5b222911cfb9" returned: 0 in 0.590s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-646f175a-97b6-421d-a583-5b222911cfb9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:26 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-646f175a-97b6-421d-a583-5b222911cfb9 Aug 05 10:29:26 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:26 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae 1G" returned: 0 in 0.756s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:26 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae Aug 05 10:29:26 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:26 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-646f175a-97b6-421d-a583-5b222911cfb9" returned: 0 in 0.365s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] Lock "cinder-quobyte-646f175a-97b6-421d-a583-5b222911cfb9" released by "delete_volume" :: held 1.047s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:26 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] Created reservations ['9aa87600-553d-4e6c-ba10-c2dc71935caf', '7f64c534-9d39-4cad-ab43-de3c7837bc89', '7d948437-2d0e-468d-9e14-1367f7387a02', 'f3b6b0db-6169-4050-a3d9-5842cfaa75e7'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:26 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:26 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:27 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:29:27 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:27 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae" returned: 0 in 0.437s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:27 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:29:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:27 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae Aug 05 10:29:27 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:27 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.310s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:27 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:27 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] Deleted volume successfully. Aug 05 10:29:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-78041cfe-bbfb-4350-b3ab-58e07dcd6f1e tempest-VolumesTransfersV357Test-1653126700 None] Lock "cinder-646f175a-97b6-421d-a583-5b222911cfb9-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:27 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae" returned: 0 in 0.307s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:27 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.info Aug 05 10:29:27 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:27 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.info" returned: 0 in 0.278s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:27 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:29:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:27 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.info Aug 05 10:29:27 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-60d9ff07-b262-4dbb-a8f5-bbe7e2e7f194 req-8461d333-a6e6-4ad7-8ece-461c2bfe63b2 tempest-ServerActionsTestOtherA-983179334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:28 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.info" returned: 0 in 0.357s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.974s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-60d9ff07-b262-4dbb-a8f5-bbe7e2e7f194 req-8461d333-a6e6-4ad7-8ece-461c2bfe63b2 tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.142s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-60d9ff07-b262-4dbb-a8f5-bbe7e2e7f194 req-8461d333-a6e6-4ad7-8ece-461c2bfe63b2 tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-60d9ff07-b262-4dbb-a8f5-bbe7e2e7f194 req-8461d333-a6e6-4ad7-8ece-461c2bfe63b2 tempest-ServerActionsTestOtherA-983179334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-b2cfcd3e-467c-474e-bc86-826ca02595be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95b57cf0-3a42-44bc-b6f5-997afa9f89e2', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Flow 'volume_create_manager' (5deb681e-1b02-4f7f-8896-25daafcfe14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bbde90-72ef-4458-ad45-803e10b61962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bbde90-72ef-4458-ad45-803e10b61962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1776521495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fc3166-e97d-41e9-8759-006df67ac1c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c274dda7a4814e3fbed2b9f6720f5c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:28Z,use_quota=True,user_id='6fa632a723e74afcbb618105356296df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da206de8-461c-4e0b-9a2d-97a33d19dfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da206de8-461c-4e0b-9a2d-97a33d19dfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc11b67-6ce0-48b0-8248-01df9120b023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc11b67-6ce0-48b0-8248-01df9120b023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63fc3166-e97d-41e9-8759-006df67ac1c5', 'volume_name': 'volume-63fc3166-e97d-41e9-8759-006df67ac1c5', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f80bbac-4d0f-406e-abc1-248b42b650d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f80bbac-4d0f-406e-abc1-248b42b650d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987475f1-2bda-47e1-8dde-3aaa29eb5438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:28 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Volume 63fc3166-e97d-41e9-8759-006df67ac1c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63fc3166-e97d-41e9-8759-006df67ac1c5', 'volume_size': 1} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1776521495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fc3166-e97d-41e9-8759-006df67ac1c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c274dda7a4814e3fbed2b9f6720f5c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:28Z,use_quota=True,user_id='6fa632a723e74afcbb618105356296df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Creating volume 63fc3166-e97d-41e9-8759-006df67ac1c5 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:28 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63fc3166-e97d-41e9-8759-006df67ac1c5 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:28 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a51f67e8-2377-44b0-a3d3-7a6d2020c6ba tempest-GroupSnapshotsTest-1753681046 None] group_snapshot 82e036ac-d7bb-4502-a91a-afb7df8e42e0: created successfully Aug 05 10:29:28 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63fc3166-e97d-41e9-8759-006df67ac1c5 1073741824 Aug 05 10:29:28 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:28 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-60d9ff07-b262-4dbb-a8f5-bbe7e2e7f194 req-8461d333-a6e6-4ad7-8ece-461c2bfe63b2 tempest-ServerActionsTestOtherA-983179334 None] attachment_update completed successfully. Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Flow 'volume_create_manager' (0a501b23-a7f5-4aab-8339-3e9d452b25a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3173093-e807-42b7-95ca-bfabe7f60e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3173093-e807-42b7-95ca-bfabe7f60e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-517694932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f3d19b-c3f7-49e4-930b-dd2fd93a62c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f0d4f7bb5fd4832be8d9535d73cb1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:29Z,use_quota=True,user_id='13642177b5c04a56a457c53c4b0fa5f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c7968f-7207-4015-b25f-33e6df0da014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c7968f-7207-4015-b25f-33e6df0da014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7142e4-ca37-49f9-bd88-85e13ceaa3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7142e4-ca37-49f9-bd88-85e13ceaa3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f3d19b-c3f7-49e4-930b-dd2fd93a62c8', 'volume_name': 'volume-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b13fee-d5b3-4aff-ad1d-745407f8fc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b13fee-d5b3-4aff-ad1d-745407f8fc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19baf214-6d7b-4805-9a4c-743319400ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:28 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Volume 34f3d19b-c3f7-49e4-930b-dd2fd93a62c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8', 'volume_size': 1} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:28 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63fc3166-e97d-41e9-8759-006df67ac1c5 1073741824" returned: 0 in 0.504s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63fc3166-e97d-41e9-8759-006df67ac1c5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:28 devstack sudo[95658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63fc3166-e97d-41e9-8759-006df67ac1c5 Aug 05 10:29:28 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:29 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63fc3166-e97d-41e9-8759-006df67ac1c5" returned: 0 in 0.484s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.637s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-517694932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f3d19b-c3f7-49e4-930b-dd2fd93a62c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f0d4f7bb5fd4832be8d9535d73cb1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:29Z,use_quota=True,user_id='13642177b5c04a56a457c53c4b0fa5f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Creating volume 34f3d19b-c3f7-49e4-930b-dd2fd93a62c8 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:29 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987475f1-2bda-47e1-8dde-3aaa29eb5438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63fc3166-e97d-41e9-8759-006df67ac1c5', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:29 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8 1073741824 Aug 05 10:29:29 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d66360d-dea3-469f-a391-775fb2208793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:29 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Volume volume-63fc3166-e97d-41e9-8759-006df67ac1c5 (63fc3166-e97d-41e9-8759-006df67ac1c5): created successfully Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d66360d-dea3-469f-a391-775fb2208793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Flow 'volume_create_manager' (5deb681e-1b02-4f7f-8896-25daafcfe14c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:29 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b3a56495-ea5b-49c1-b783-b3b2d5c2f0a5 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Created volume successfully. Aug 05 10:29:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:30 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8 1073741824" returned: 0 in 0.685s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:30 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8 Aug 05 10:29:30 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:30 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8" returned: 0 in 0.309s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.577s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "cinder-quobyte-448e3bb0-8741-435a-8ae9-ece5b9cf75ae-7fcefb97-2229-434e-959d-13027ab25d5d" by "_create_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19baf214-6d7b-4805-9a4c-743319400ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ad9150-88e6-465a-a364-378394c3fc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-448e3bb0-8741-435a-8ae9-ece5b9cf75ae-7fcefb97-2229-434e-959d-13027ab25d5d" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Creating volume 7fcefb97-2229-434e-959d-13027ab25d5d from snapshot 448e3bb0-8741-435a-8ae9-ece5b9cf75ae {{(pid=88736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "cinder-quobyte-7fcefb97-2229-434e-959d-13027ab25d5d" by "_copy_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:30 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Volume volume-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8 (34f3d19b-c3f7-49e4-930b-dd2fd93a62c8): created successfully Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ad9150-88e6-465a-a364-378394c3fc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Flow 'volume_create_manager' (0a501b23-a7f5-4aab-8339-3e9d452b25a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-7fcefb97-2229-434e-959d-13027ab25d5d" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] snapshot: 448e3bb0-8741-435a-8ae9-ece5b9cf75ae, volume: 7fcefb97-2229-434e-959d-13027ab25d5d, {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:29:30 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-6c8e25d8-20ae-4cc4-a3d4-9348695e11b2 tempest-VolumesTransfersV357Test-386764055 None] Created volume successfully. Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab5eace-817c-4a59-b671-03405b7bd5ba]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:30 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae Aug 05 10:29:30 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:31 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae" returned: 0 in 0.505s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac6c342-c6f1-4e76-8715-958a55876cc5]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] Acquiring lock "cinder-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] Lock "cinder-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] Acquiring lock "cinder-quobyte-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] Lock "cinder-quobyte-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8" acquired by "delete_volume" :: waited 0.032s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:31 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 Aug 05 10:29:31 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[93af16da-73b1-4a70-b89d-e7491449fcaf]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:31 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8 Aug 05 10:29:31 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Acquiring lock "cinder-63fc3166-e97d-41e9-8759-006df67ac1c5-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Lock "cinder-63fc3166-e97d-41e9-8759-006df67ac1c5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:31 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4" returned: 0 in 0.521s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] will copy from snapshot at /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Creating direct copy from snapshot {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG cinder.utils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Path /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7fcefb97-2229-434e-959d-13027ab25d5d not found in is_blk_device check {{(pid=88736) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7fcefb97-2229-434e-959d-13027ab25d5d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Acquiring lock "cinder-quobyte-63fc3166-e97d-41e9-8759-006df67ac1c5" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Lock "cinder-quobyte-63fc3166-e97d-41e9-8759-006df67ac1c5" acquired by "delete_volume" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:31 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7fcefb97-2229-434e-959d-13027ab25d5d Aug 05 10:29:31 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[356dcdfb-8e8a-4ec4-a530-b1af7c75dfbe]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63fc3166-e97d-41e9-8759-006df67ac1c5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:31 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:31 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63fc3166-e97d-41e9-8759-006df67ac1c5 Aug 05 10:29:31 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8" returned: 0 in 0.505s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:31 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8 Aug 05 10:29:31 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:32 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8" returned: 0 in 0.512s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] Lock "cinder-quobyte-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8" released by "delete_volume" :: held 1.126s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:32 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63fc3166-e97d-41e9-8759-006df67ac1c5" returned: 0 in 0.937s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63fc3166-e97d-41e9-8759-006df67ac1c5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:32 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] Created reservations ['2c06cf08-7bfc-4770-90e6-49fc470dde5d', '02f4f8f4-529b-4cbd-910e-78a51c5b8fb4', '285ee969-ea8f-42d3-b258-fb35f6dd39ff', '20260e8a-212e-4b44-a97e-fa9fea88a17e'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:32 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63fc3166-e97d-41e9-8759-006df67ac1c5 Aug 05 10:29:32 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:33 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:29:33 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:34 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.850s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:34 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:34 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:34 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] Deleted volume successfully. Aug 05 10:29:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63fc3166-e97d-41e9-8759-006df67ac1c5" returned: 0 in 1.505s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Lock "cinder-quobyte-63fc3166-e97d-41e9-8759-006df67ac1c5" released by "delete_volume" :: held 2.547s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0af36f05-d291-46ae-b551-7775fbc738cd tempest-VolumesTransfersV357Test-1653126700 None] Lock "cinder-34f3d19b-c3f7-49e4-930b-dd2fd93a62c8-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:34 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Created reservations ['6eb455a1-8786-45a4-814b-5436c830b04b', 'e8e8ef33-beba-4b9b-a3a0-ce4635193d2b', 'b0d00612-130a-4893-9f92-c547e5fbac9b', 'cd2c0608-d71d-4ac0-9607-922e9d97d7db'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:34 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:29:34 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:35 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.752s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:35 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:35 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Deleted volume successfully. Aug 05 10:29:35 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-daaa8b05-7be0-4b8c-91aa-278d23db1494 tempest-VolumeQuotasNegativeTestJSON-976073010 None] Lock "cinder-63fc3166-e97d-41e9-8759-006df67ac1c5-delete_volume" released by "delete_volume" :: held 4.128s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:39 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7fcefb97-2229-434e-959d-13027ab25d5d" returned: 0 in 7.877s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:39 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Image conversion details: src /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4, size 1024.00 MB, duration 7.88 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7fcefb97-2229-434e-959d-13027ab25d5d {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:29:39 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Converted 1024.00 MB image at 129.99 MB/s Aug 05 10:29:39 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7fcefb97-2229-434e-959d-13027ab25d5d is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:29:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7fcefb97-2229-434e-959d-13027ab25d5d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:39 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7fcefb97-2229-434e-959d-13027ab25d5d Aug 05 10:29:39 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:39 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7fcefb97-2229-434e-959d-13027ab25d5d" returned: 0 in 0.400s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-7fcefb97-2229-434e-959d-13027ab25d5d" released by "_copy_volume_from_snapshot" :: held 9.440s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:40 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-448e3bb0-8741-435a-8ae9-ece5b9cf75ae-7fcefb97-2229-434e-959d-13027ab25d5d" released by "_create_volume_from_snapshot" :: held 9.560s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.595s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:40 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-03d1e24e-0101-4292-9a72-bf9b70740500 tempest-GroupSnapshotsTest-1753681046 None] Create group from source-snapshot-82e036ac-d7bb-4502-a91a-afb7df8e42e0 completed successfully. Aug 05 10:29:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "cinder-quobyte-7fcefb97-2229-434e-959d-13027ab25d5d" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-7fcefb97-2229-434e-959d-13027ab25d5d" acquired by "delete_volume" :: waited 0.027s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:41 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c5d6d6-8256-4403-95be-f98035eb6387]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7fcefb97-2229-434e-959d-13027ab25d5d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:41 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7fcefb97-2229-434e-959d-13027ab25d5d Aug 05 10:29:41 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:42 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7fcefb97-2229-434e-959d-13027ab25d5d" returned: 0 in 0.705s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7fcefb97-2229-434e-959d-13027ab25d5d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:42 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7fcefb97-2229-434e-959d-13027ab25d5d Aug 05 10:29:42 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:42 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7fcefb97-2229-434e-959d-13027ab25d5d" returned: 0 in 0.356s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-7fcefb97-2229-434e-959d-13027ab25d5d" released by "delete_volume" :: held 1.168s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:42 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] Created reservations ['2a77621b-1591-452d-9401-7caa6863b2fe'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:42 devstack cinder-volume[88736]: WARNING cinder.quota [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-777101474 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-777101474, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:29:42 devstack cinder-volume[88736]: WARNING cinder.quota [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-777101474 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-777101474, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:29:43 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] Created reservations ['12fd7f3c-af1d-421d-9baf-bb09c04246ac', '25f6c210-fc74-4082-a034-2748d04acaab', '1de65d22-427a-47ff-8ac7-cb4e5d38de1b', '2c8c2246-84a8-4161-a07d-f86ca94927ee'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:43 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:29:43 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:43 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.344s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:43 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:43 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a9bb3cd9-6a8c-472e-a2e7-984710219bb8 tempest-GroupSnapshotsTest-1753681046 None] Delete group completed successfully. Aug 05 10:29:44 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] group_snapshot 82e036ac-d7bb-4502-a91a-afb7df8e42e0: deleting Aug 05 10:29:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] group_snapshot 82e036ac-d7bb-4502-a91a-afb7df8e42e0: deleting {{(pid=88736) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 10:29:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "cinder-quobyte-35cd6f9d-795d-421f-9262-8b59c3ef23b4" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-35cd6f9d-795d-421f-9262-8b59c3ef23b4" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "cinder-quobyte-448e3bb0-8741-435a-8ae9-ece5b9cf75ae" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-448e3bb0-8741-435a-8ae9-ece5b9cf75ae" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] Deleting offline snapshot 448e3bb0-8741-435a-8ae9-ece5b9cf75ae of volume 35cd6f9d-795d-421f-9262-8b59c3ef23b4 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:29:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] snapshot_file for this snap is: volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:29:44 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb94da7-b601-4f1c-b871-36e19ae2d66e]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:44 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae Aug 05 10:29:44 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:45 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae" returned: 0 in 0.457s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:29:45 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d66603-85be-40df-b868-a0c0bf7abe64]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:45 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 Aug 05 10:29:45 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:45 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4" returned: 0 in 0.615s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:45 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae Aug 05 10:29:45 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:46 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae" returned: 0 in 0.523s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:46 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae Aug 05 10:29:46 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:46 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4.448e3bb0-8741-435a-8ae9-ece5b9cf75ae" returned: 0 in 0.276s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-448e3bb0-8741-435a-8ae9-ece5b9cf75ae" released by "_delete_snapshot" :: held 1.995s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-35cd6f9d-795d-421f-9262-8b59c3ef23b4" released by "delete_snapshot" :: held 2.035s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:46 devstack cinder-volume[88736]: WARNING cinder.quota [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-777101474 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-777101474, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:29:46 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] Created reservations ['59a9df65-7ae1-4b97-ab75-b3cc8cd84670', 'bbbf8e52-b64d-452a-8164-533570d5d0f2', '7bf8d3cf-6662-49a6-91a5-94c5e9b1f91d', '6228d18f-18cc-4160-8357-770fd6ce0d0d'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:46 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-0486b89e-d3d5-4d80-9868-045854daff53 tempest-GroupSnapshotsTest-1753681046 None] group_snapshot 82e036ac-d7bb-4502-a91a-afb7df8e42e0: deleted successfully Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Flow 'volume_create_manager' (3757f852-00d7-4a20-a0c4-f38388c6df62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f533e07-afec-4999-a081-5163a281c405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f533e07-afec-4999-a081-5163a281c405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1313488048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3cb431c-67fa-4010-bf79-3cdb3da278f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94839857fc541f6997db6a897d41a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:47Z,use_quota=True,user_id='00dfa0ce5225460bb6c479ed70c2aee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed03954b-511b-4b6a-99ff-9d94221dde34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed03954b-511b-4b6a-99ff-9d94221dde34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae2606d-09a9-4a2e-bdbc-a36793c05d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae2606d-09a9-4a2e-bdbc-a36793c05d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3cb431c-67fa-4010-bf79-3cdb3da278f8', 'volume_name': 'volume-d3cb431c-67fa-4010-bf79-3cdb3da278f8', 'volume_size': 2}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4509e0-e265-4424-9e71-02e21c2b80fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4509e0-e265-4424-9e71-02e21c2b80fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ad06d7-c744-419f-9a61-2ce9bbfe45ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:47 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Volume d3cb431c-67fa-4010-bf79-3cdb3da278f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3cb431c-67fa-4010-bf79-3cdb3da278f8', 'volume_size': 2} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1313488048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3cb431c-67fa-4010-bf79-3cdb3da278f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94839857fc541f6997db6a897d41a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:47Z,use_quota=True,user_id='00dfa0ce5225460bb6c479ed70c2aee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Creating volume d3cb431c-67fa-4010-bf79-3cdb3da278f8 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:47 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d3cb431c-67fa-4010-bf79-3cdb3da278f8 2147483648 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:47 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d3cb431c-67fa-4010-bf79-3cdb3da278f8 2147483648 Aug 05 10:29:47 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "cinder-quobyte-35cd6f9d-795d-421f-9262-8b59c3ef23b4" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Flow 'volume_create_manager' (12b50089-b842-4180-9c9a-df2111e18f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b049228-4256-4785-9567-5faee6d687a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b049228-4256-4785-9567-5faee6d687a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1079410449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41a5429-6292-4cbd-afe5-117e1a1b1fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a60c1af6e54f09b6187f9c2910b9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:47Z,use_quota=True,user_id='5b8f5f0e7e4a4b0d976c1d7ca07308e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c605c9-eb0a-4712-a5ba-a439a980bc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c605c9-eb0a-4712-a5ba-a439a980bc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939a0bac-5b36-4c0b-87d8-62ab038ec7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939a0bac-5b36-4c0b-87d8-62ab038ec7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a41a5429-6292-4cbd-afe5-117e1a1b1fb9', 'volume_name': 'volume-a41a5429-6292-4cbd-afe5-117e1a1b1fb9', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e065ad75-15a8-4bf7-83c7-0800543e23dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e065ad75-15a8-4bf7-83c7-0800543e23dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f9900f-2a7a-459e-a3c0-3db729d46c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:47 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Volume a41a5429-6292-4cbd-afe5-117e1a1b1fb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a41a5429-6292-4cbd-afe5-117e1a1b1fb9', 'volume_size': 1} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-35cd6f9d-795d-421f-9262-8b59c3ef23b4" acquired by "delete_volume" :: waited 0.107s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e300f367-4422-43ed-b094-1da0c065949d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:47 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 Aug 05 10:29:47 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:47 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d3cb431c-67fa-4010-bf79-3cdb3da278f8 2147483648" returned: 0 in 0.624s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d3cb431c-67fa-4010-bf79-3cdb3da278f8 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:47 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d3cb431c-67fa-4010-bf79-3cdb3da278f8 Aug 05 10:29:47 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:48 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4" returned: 0 in 0.426s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:48 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4 Aug 05 10:29:48 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:48 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d3cb431c-67fa-4010-bf79-3cdb3da278f8" returned: 0 in 0.299s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.602s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1079410449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41a5429-6292-4cbd-afe5-117e1a1b1fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a60c1af6e54f09b6187f9c2910b9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:47Z,use_quota=True,user_id='5b8f5f0e7e4a4b0d976c1d7ca07308e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Creating volume a41a5429-6292-4cbd-afe5-117e1a1b1fb9 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:48 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a41a5429-6292-4cbd-afe5-117e1a1b1fb9 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ad06d7-c744-419f-9a61-2ce9bbfe45ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3cb431c-67fa-4010-bf79-3cdb3da278f8', 'volume_size': 2}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa1be52-e776-4ac1-bc1f-a497de595974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:48 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a41a5429-6292-4cbd-afe5-117e1a1b1fb9 1073741824 Aug 05 10:29:48 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:48 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Volume volume-d3cb431c-67fa-4010-bf79-3cdb3da278f8 (d3cb431c-67fa-4010-bf79-3cdb3da278f8): created successfully Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa1be52-e776-4ac1-bc1f-a497de595974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Flow 'volume_create_manager' (3757f852-00d7-4a20-a0c4-f38388c6df62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:48 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-9b744ca9-3680-4794-b750-a4e0cd9aaa6a tempest-VolumesCloneNegativeTest-122887514 None] Created volume successfully. Aug 05 10:29:48 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-35cd6f9d-795d-421f-9262-8b59c3ef23b4" returned: 0 in 0.376s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-35cd6f9d-795d-421f-9262-8b59c3ef23b4" released by "delete_volume" :: held 0.858s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] Created reservations ['a8072a04-4654-4130-9370-49e19d350609'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:48 devstack cinder-volume[88736]: WARNING cinder.db.api [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-777101474'] Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] Created reservations ['75ec4e15-f022-4046-b763-6de980138be2', '21d68f96-3fda-4a68-bcfe-54660df84834', '9451c12b-6953-40ea-b6c1-ce63f67db063', 'f9acebca-5f7c-4733-bbc6-d868b14cffca'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:48 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:29:48 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:48 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a41a5429-6292-4cbd-afe5-117e1a1b1fb9 1073741824" returned: 0 in 0.671s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a41a5429-6292-4cbd-afe5-117e1a1b1fb9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:48 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a41a5429-6292-4cbd-afe5-117e1a1b1fb9 Aug 05 10:29:48 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:48 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.291s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:48 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:48 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8845a5b9-316d-4aee-902a-eec82231d685 tempest-GroupSnapshotsTest-1753681046 None] Delete group completed successfully. Aug 05 10:29:49 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a41a5429-6292-4cbd-afe5-117e1a1b1fb9" returned: 0 in 0.271s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f9900f-2a7a-459e-a3c0-3db729d46c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41a5429-6292-4cbd-afe5-117e1a1b1fb9', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbf6544-c095-45a8-8b59-e2eaea4086f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:49 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Volume volume-a41a5429-6292-4cbd-afe5-117e1a1b1fb9 (a41a5429-6292-4cbd-afe5-117e1a1b1fb9): created successfully Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbf6544-c095-45a8-8b59-e2eaea4086f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Flow 'volume_create_manager' (12b50089-b842-4180-9c9a-df2111e18f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:49 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-2d732971-096c-4110-941b-4cb87b17a155 tempest-VolumesServicesTestJSON-1002177508 None] Created volume successfully. Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] Acquiring lock "cinder-d3cb431c-67fa-4010-bf79-3cdb3da278f8-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] Lock "cinder-d3cb431c-67fa-4010-bf79-3cdb3da278f8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] Acquiring lock "cinder-quobyte-d3cb431c-67fa-4010-bf79-3cdb3da278f8" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] Lock "cinder-quobyte-d3cb431c-67fa-4010-bf79-3cdb3da278f8" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea85137d-9736-44a5-a66e-fe1fccb3b466]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d3cb431c-67fa-4010-bf79-3cdb3da278f8 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:49 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d3cb431c-67fa-4010-bf79-3cdb3da278f8 Aug 05 10:29:49 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] Acquiring lock "cinder-a41a5429-6292-4cbd-afe5-117e1a1b1fb9-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] Lock "cinder-a41a5429-6292-4cbd-afe5-117e1a1b1fb9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] Acquiring lock "cinder-quobyte-a41a5429-6292-4cbd-afe5-117e1a1b1fb9" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] Lock "cinder-quobyte-a41a5429-6292-4cbd-afe5-117e1a1b1fb9" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1657ac44-a91d-4be3-97c8-bd1a4f582a1a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a41a5429-6292-4cbd-afe5-117e1a1b1fb9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:49 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d3cb431c-67fa-4010-bf79-3cdb3da278f8" returned: 0 in 0.502s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d3cb431c-67fa-4010-bf79-3cdb3da278f8 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:50 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d3cb431c-67fa-4010-bf79-3cdb3da278f8 Aug 05 10:29:50 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:50 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a41a5429-6292-4cbd-afe5-117e1a1b1fb9 Aug 05 10:29:50 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:50 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b2daf07d-e43f-433c-b354-d50857f487f0 tempest-GroupSnapshotsTest-1753681046 None] Group tempest-GroupSnapshotsTest-Group-305749874: creating Aug 05 10:29:50 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b2daf07d-e43f-433c-b354-d50857f487f0 tempest-GroupSnapshotsTest-1753681046 None] Group tempest-GroupSnapshotsTest-Group-305749874: created successfully Aug 05 10:29:50 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b2daf07d-e43f-433c-b354-d50857f487f0 tempest-GroupSnapshotsTest-1753681046 None] Create group completed successfully. Aug 05 10:29:50 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d3cb431c-67fa-4010-bf79-3cdb3da278f8" returned: 0 in 0.401s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] Lock "cinder-quobyte-d3cb431c-67fa-4010-bf79-3cdb3da278f8" released by "delete_volume" :: held 0.954s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:50 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a41a5429-6292-4cbd-afe5-117e1a1b1fb9" returned: 0 in 0.597s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a41a5429-6292-4cbd-afe5-117e1a1b1fb9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:50 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a41a5429-6292-4cbd-afe5-117e1a1b1fb9 Aug 05 10:29:50 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] Created reservations ['a41db4ed-1f32-435c-8e51-fbda84a9857a', '9fa106ce-056d-43d6-ac91-30c2c13033a1', '4f4fb740-e222-4571-8772-e04e3896b817', 'f8139f7a-e282-4c85-aea1-ec57d6bf20f6'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:50 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:29:50 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:50 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a41a5429-6292-4cbd-afe5-117e1a1b1fb9" returned: 0 in 0.327s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] Lock "cinder-quobyte-a41a5429-6292-4cbd-afe5-117e1a1b1fb9" released by "delete_volume" :: held 0.981s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:50 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] Created reservations ['889f28ea-65a6-4e8a-9565-bf173ab5bd13', '25b6a49b-ac41-4792-ab8d-0f1d0614089d', '57e07a05-ec80-46b4-b17f-94e4f3baa76d', 'a4e0d583-a925-464b-a7cb-95de7ae7ebc9'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.299s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:50 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] Deleted volume successfully. Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a6b92563-3fba-4064-b058-3ea750f8e2bb tempest-VolumesCloneNegativeTest-122887514 None] Lock "cinder-d3cb431c-67fa-4010-bf79-3cdb3da278f8-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:50 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:29:50 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:51 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.262s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:51 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:29:51 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] Deleted volume successfully. Aug 05 10:29:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c68196ae-673d-4520-8f04-4d97ec23c5f4 tempest-VolumesServicesTestJSON-1002177508 None] Lock "cinder-a41a5429-6292-4cbd-afe5-117e1a1b1fb9-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Flow 'volume_create_manager' (602fbefb-1107-4dfd-ab78-f5375df46c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d7e58d-c063-4d03-842f-134e7d561748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d7e58d-c063-4d03-842f-134e7d561748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1813347655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55e58405-deb6-4ac6-b917-b30041c343d5,host='devstack@QuobyteHD#QuobyteHD',id=43e93c4c-7e15-4850-beff-cd4e483290a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5faedda4ed74ed2a21252af374d1296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:52Z,use_quota=True,user_id='2a11aac3337445aeafd061523963668e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5f016d9-3543-4401-8420-d207e4c781dd),volume_type_id=c5f016d9-3543-4401-8420-d207e4c781dd)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4337263f-5125-46f9-aac6-aa5988619859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4337263f-5125-46f9-aac6-aa5988619859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320a1a7d-fb92-43f8-8034-9a9a1b30cfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320a1a7d-fb92-43f8-8034-9a9a1b30cfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43e93c4c-7e15-4850-beff-cd4e483290a3', 'volume_name': 'volume-43e93c4c-7e15-4850-beff-cd4e483290a3', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e96e50-dace-4d27-8eda-687ba5d52e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e96e50-dace-4d27-8eda-687ba5d52e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9811ab17-64e5-4f87-8dc7-dd7de97b40c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:52 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Volume 43e93c4c-7e15-4850-beff-cd4e483290a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43e93c4c-7e15-4850-beff-cd4e483290a3', 'volume_size': 1} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=55e58405-deb6-4ac6-b917-b30041c343d5,created_at=2026-08-05T08:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1813347655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55e58405-deb6-4ac6-b917-b30041c343d5,host='devstack@QuobyteHD#QuobyteHD',id=43e93c4c-7e15-4850-beff-cd4e483290a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5faedda4ed74ed2a21252af374d1296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:52Z,use_quota=True,user_id='2a11aac3337445aeafd061523963668e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5f016d9-3543-4401-8420-d207e4c781dd),volume_type_id=c5f016d9-3543-4401-8420-d207e4c781dd)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Creating volume 43e93c4c-7e15-4850-beff-cd4e483290a3 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:52 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:52 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3 1073741824 Aug 05 10:29:52 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:52 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3 1073741824" returned: 0 in 0.557s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:52 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3 Aug 05 10:29:52 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:53 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3" returned: 0 in 0.270s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9811ab17-64e5-4f87-8dc7-dd7de97b40c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43e93c4c-7e15-4850-beff-cd4e483290a3', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f384961a-1826-4d2e-8fd4-2dc2a5e1f4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:53 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Volume volume-43e93c4c-7e15-4850-beff-cd4e483290a3 (43e93c4c-7e15-4850-beff-cd4e483290a3): created successfully Aug 05 10:29:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f384961a-1826-4d2e-8fd4-2dc2a5e1f4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Flow 'volume_create_manager' (602fbefb-1107-4dfd-ab78-f5375df46c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:53 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-02601c81-09cd-4978-94fb-fb7689babe53 tempest-GroupSnapshotsTest-1753681046 None] Created volume successfully. Aug 05 10:29:53 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Flow 'volume_create_manager' (1415f038-159e-4311-922f-a5e27a61abf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd590577-ea96-4e04-a02c-d840e69a21d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd590577-ea96-4e04-a02c-d840e69a21d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-167109682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55e58405-deb6-4ac6-b917-b30041c343d5,host='devstack@QuobyteHD#QuobyteHD',id=bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5faedda4ed74ed2a21252af374d1296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:54Z,use_quota=True,user_id='2a11aac3337445aeafd061523963668e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5f016d9-3543-4401-8420-d207e4c781dd),volume_type_id=c5f016d9-3543-4401-8420-d207e4c781dd)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7810db0c-9526-497c-aade-bc3cb01ee418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7810db0c-9526-497c-aade-bc3cb01ee418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6f63cf-2161-46cf-8d79-26d1df313f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6f63cf-2161-46cf-8d79-26d1df313f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9', 'volume_name': 'volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6af82b-e655-432e-9001-1018e321696f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6af82b-e655-432e-9001-1018e321696f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb007c0f-2cf8-415b-873d-6d1494f7036d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:54 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Volume bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9', 'volume_size': 1} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=55e58405-deb6-4ac6-b917-b30041c343d5,created_at=2026-08-05T08:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-167109682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55e58405-deb6-4ac6-b917-b30041c343d5,host='devstack@QuobyteHD#QuobyteHD',id=bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5faedda4ed74ed2a21252af374d1296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:54Z,use_quota=True,user_id='2a11aac3337445aeafd061523963668e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5f016d9-3543-4401-8420-d207e4c781dd),volume_type_id=c5f016d9-3543-4401-8420-d207e4c781dd)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Creating volume bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:54 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:54 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 1073741824 Aug 05 10:29:54 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:54 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 1073741824" returned: 0 in 0.494s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:54 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 Aug 05 10:29:54 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:54 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9" returned: 0 in 0.300s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb007c0f-2cf8-415b-873d-6d1494f7036d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8546dcca-3515-4401-aaae-34c4602f6b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:54 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Volume volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 (bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9): created successfully Aug 05 10:29:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8546dcca-3515-4401-aaae-34c4602f6b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Flow 'volume_create_manager' (1415f038-159e-4311-922f-a5e27a61abf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:55 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-076813fa-1ad5-40ee-b89d-18ce564a89ad tempest-GroupSnapshotsTest-1753681046 None] Created volume successfully. Aug 05 10:29:55 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c02ebf25-8400-482d-b618-67d1e065ec5b tempest-GroupSnapshotsTest-1753681046 None] Update group completed successfully. Aug 05 10:29:56 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ff9cc3ca-1909-4288-bec5-1bb540053312 tempest-GroupSnapshotsTest-1753681046 None] Update group completed successfully. Aug 05 10:29:58 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-991896c3-d067-4800-8772-edf8186c8869 tempest-GroupSnapshotsTest-1753681046 None] Update group completed successfully. Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Flow 'volume_create_manager' (1eb0ec7d-1def-4eb7-a7ef-6da3b6bc05ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c2a6e0-f235-4b52-bb20-1e31e20e1ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c2a6e0-f235-4b52-bb20-1e31e20e1ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1466484366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdc0c412-a109-4f88-a594-b68ab0c30194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='620ae56492d747b2bef7da3279099f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:59Z,use_quota=True,user_id='9ab0036283754e2284ca3bc0b14b2395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f88898-ea78-4c27-acc2-13af2afec580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f88898-ea78-4c27-acc2-13af2afec580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e7b9d1-b59c-4a20-9479-6d7031c8b79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e7b9d1-b59c-4a20-9479-6d7031c8b79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdc0c412-a109-4f88-a594-b68ab0c30194', 'volume_name': 'volume-fdc0c412-a109-4f88-a594-b68ab0c30194', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60730122-c449-4b27-a576-4f5516bbcac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60730122-c449-4b27-a576-4f5516bbcac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa59129-8426-4378-a31c-e1f192ebfed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:29:58 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Volume fdc0c412-a109-4f88-a594-b68ab0c30194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdc0c412-a109-4f88-a594-b68ab0c30194', 'volume_size': 1} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1466484366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdc0c412-a109-4f88-a594-b68ab0c30194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='620ae56492d747b2bef7da3279099f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:29:59Z,use_quota=True,user_id='9ab0036283754e2284ca3bc0b14b2395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Creating volume fdc0c412-a109-4f88-a594-b68ab0c30194 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:29:58 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:29:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:59 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194 1073741824 Aug 05 10:29:59 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:29:59 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1d2864b3-b2da-4907-a423-d9e266682393 tempest-GroupSnapshotsTest-1753681046 None] Update group completed successfully. Aug 05 10:29:59 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Aug 05 10:29:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194 1073741824" returned: 0 in 0.600s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:29:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:29:59 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194 Aug 05 10:29:59 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:00 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194" returned: 0 in 0.352s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:30:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa59129-8426-4378-a31c-e1f192ebfed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdc0c412-a109-4f88-a594-b68ab0c30194', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef3d586-537e-4f4d-82c0-94a0061247eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:00 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Volume volume-fdc0c412-a109-4f88-a594-b68ab0c30194 (fdc0c412-a109-4f88-a594-b68ab0c30194): created successfully Aug 05 10:30:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef3d586-537e-4f4d-82c0-94a0061247eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Flow 'volume_create_manager' (1eb0ec7d-1def-4eb7-a7ef-6da3b6bc05ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:00 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-12001682-da6e-4804-ba0f-b7e1c2d78748 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Created volume successfully. Aug 05 10:30:00 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] GroupSnapshot 2948bed2-8406-412f-858c-950cd962336f: creating. Aug 05 10:30:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Group snapshot 2948bed2-8406-412f-858c-950cd962336f: creating. {{(pid=88736) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 10:30:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Creating offline snapshot 3c720229-3427-4e21-99d6-c7e1a2a2db48 of volume 43e93c4c-7e15-4850-beff-cd4e483290a3 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:30:01 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4589f26-1bbd-457a-bdff-b0449dfc4d2d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:01 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3 Aug 05 10:30:01 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:01 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3" returned: 0 in 0.592s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:01 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48 1G Aug 05 10:30:01 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:02 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48 1G" returned: 0 in 0.591s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43e93c4c-7e15-4850-beff-cd4e483290a3 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:02 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43e93c4c-7e15-4850-beff-cd4e483290a3 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48 Aug 05 10:30:02 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:02 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43e93c4c-7e15-4850-beff-cd4e483290a3 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48" returned: 0 in 0.361s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:02 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:30:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:02 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48 Aug 05 10:30:02 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:02 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48" returned: 0 in 0.274s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:02 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.info Aug 05 10:30:02 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:03 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.info" returned: 0 in 0.280s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:03 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:30:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:03 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.info Aug 05 10:30:03 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:03 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.info" returned: 0 in 0.305s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Creating offline snapshot 65dd007c-4843-48ef-819b-b760e5e51f66 of volume bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:30:03 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8fa6a5-3bb8-4e33-a05b-44f4bbf96cce]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:03 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 Aug 05 10:30:03 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:04 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9" returned: 0 in 0.516s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:04 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66 1G Aug 05 10:30:04 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:04 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66 1G" returned: 0 in 0.690s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:04 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66 Aug 05 10:30:04 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:05 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66" returned: 0 in 0.563s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:05 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:30:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:05 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66 Aug 05 10:30:05 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:05 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:30:05 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Flow 'volume_create_manager' (aafee03f-d2fe-4157-8108-293fba66185b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6fca5c-2c61-4741-8f1e-bd51f43d7daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66" returned: 0 in 0.356s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6fca5c-2c61-4741-8f1e-bd51f43d7daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-403507073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a6d6f4-72d7-4629-a681-70626c1029d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1200cd63afa4175a61e9b5613680143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:06Z,use_quota=True,user_id='ed760878836741cfbbac0f719e81272b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0a684e-3d7f-4b24-bcd4-9ae1e87a5984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0a684e-3d7f-4b24-bcd4-9ae1e87a5984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b3e5ba-8ceb-4ccf-977e-9a1c5c075811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b3e5ba-8ceb-4ccf-977e-9a1c5c075811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a6d6f4-72d7-4629-a681-70626c1029d9', 'volume_name': 'volume-e3a6d6f4-72d7-4629-a681-70626c1029d9', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49522f39-805c-44b1-af21-ce03cb4a5932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49522f39-805c-44b1-af21-ce03cb4a5932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad156398-c43e-440a-ac46-e62b46fb0a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:05 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Volume e3a6d6f4-72d7-4629-a681-70626c1029d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a6d6f4-72d7-4629-a681-70626c1029d9', 'volume_size': 1} Aug 05 10:30:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:05 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.info Aug 05 10:30:05 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:06 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.info" returned: 0 in 0.268s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:06 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:30:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:06 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.info Aug 05 10:30:06 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:06 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.info" returned: 0 in 0.260s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.802s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.898s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Creating offline snapshot 8616b795-0efe-49e1-b570-db3a9ba4c8f0 of volume fdc0c412-a109-4f88-a594-b68ab0c30194 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:30:06 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc82c11-fa91-4054-814d-4ff23f427ad8]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:06 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b63e1636-909f-4fdd-b439-b052b74879e7 tempest-GroupSnapshotsTest-1753681046 None] group_snapshot 2948bed2-8406-412f-858c-950cd962336f: created successfully Aug 05 10:30:06 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194 Aug 05 10:30:06 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:06 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-d97ec82d-b6b9-44f4-99cd-d84da23f1877 tempest-ServerActionsTestOtherA-983179334 None] Terminate volume connection completed successfully. Aug 05 10:30:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-d97ec82d-b6b9-44f4-99cd-d84da23f1877 tempest-ServerActionsTestOtherA-983179334 None] Deleting attachment 95b57cf0-3a42-44bc-b6f5-997afa9f89e2. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:30:06 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194" returned: 0 in 0.412s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:06 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0 1G Aug 05 10:30:06 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] Acquiring lock "cinder-b2cfcd3e-467c-474e-bc86-826ca02595be-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] Lock "cinder-b2cfcd3e-467c-474e-bc86-826ca02595be-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] Acquiring lock "cinder-quobyte-b2cfcd3e-467c-474e-bc86-826ca02595be" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] Lock "cinder-quobyte-b2cfcd3e-467c-474e-bc86-826ca02595be" acquired by "delete_volume" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:06 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb37712-f1a9-4d26-87a4-188a502122c4]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:07 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be Aug 05 10:30:07 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:07 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0 1G" returned: 0 in 0.518s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdc0c412-a109-4f88-a594-b68ab0c30194 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:07 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdc0c412-a109-4f88-a594-b68ab0c30194 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0 Aug 05 10:30:07 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:07 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be" returned: 0 in 0.487s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:07 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be Aug 05 10:30:07 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:07 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] group_snapshot 2948bed2-8406-412f-858c-950cd962336f: deleting Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=141,cinder:UPDATE=125,cinder:INSERT=29,cinder:DELETE=7 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:30:07 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdc0c412-a109-4f88-a594-b68ab0c30194 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0" returned: 0 in 0.395s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:07 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0 is being set with open permissions: ugo+rw Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=118,cinder:INSERT=30,cinder:UPDATE=148,cinder:DELETE=10 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:30:07 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0 Aug 05 10:30:07 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] group_snapshot 2948bed2-8406-412f-858c-950cd962336f: deleting {{(pid=88736) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "cinder-quobyte-43e93c4c-7e15-4850-beff-cd4e483290a3" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:07 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b2cfcd3e-467c-474e-bc86-826ca02595be" returned: 0 in 0.317s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-43e93c4c-7e15-4850-beff-cd4e483290a3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "cinder-quobyte-3c720229-3427-4e21-99d6-c7e1a2a2db48" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] Lock "cinder-quobyte-b2cfcd3e-467c-474e-bc86-826ca02595be" released by "delete_volume" :: held 0.863s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-3c720229-3427-4e21-99d6-c7e1a2a2db48" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Deleting offline snapshot 3c720229-3427-4e21-99d6-c7e1a2a2db48 of volume 43e93c4c-7e15-4850-beff-cd4e483290a3 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] snapshot_file for this snap is: volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd85cbb-9ba0-4018-acda-c3378afbc66f]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG cinder.quota [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] Created reservations ['db44522f-7dce-41af-9e20-b9d11d9f904b', 'c4ed491b-89c7-459d-9b8d-8c72c9cf159b', 'b2960518-38e4-44d1-a926-9aa8a3f4f856', '75cb4b26-8341-4dea-a514-be75173bb531'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:07 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0" returned: 0 in 0.311s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:07 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48 Aug 05 10:30:07 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:07 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:30:07 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:08 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.info Aug 05 10:30:08 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:08 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.310s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG cinder.manager [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:30:08 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] Deleted volume successfully. Aug 05 10:30:08 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48" returned: 0 in 0.473s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43e93c4c-7e15-4850-beff-cd4e483290a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] Acquiring lock "cinder-0b836fdf-8ca1-40ff-b721-444ff5b2b722-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60b1fdb-7c65-4693-bee8-d0b0863b97a8]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-85b618c9-d8f9-45f0-b2ab-f5552edc2241 req-34f4bf08-8a83-4577-a945-9c622ed29cea tempest-ServerActionsTestOtherA-983179334 None] Lock "cinder-b2cfcd3e-467c-474e-bc86-826ca02595be-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] Lock "cinder-0b836fdf-8ca1-40ff-b721-444ff5b2b722-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:08 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.info" returned: 0 in 0.357s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:08 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.info is being set with open permissions: ugo+rw Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:08 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.info Aug 05 10:30:08 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] Acquiring lock "cinder-quobyte-0b836fdf-8ca1-40ff-b721-444ff5b2b722" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] Lock "cinder-quobyte-0b836fdf-8ca1-40ff-b721-444ff5b2b722" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f225e61-cd86-4903-93dc-d52771d42fe7]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:08 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3 Aug 05 10:30:08 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:08 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722 Aug 05 10:30:08 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:08 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.info" returned: 0 in 0.328s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.436s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.015s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-403507073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a6d6f4-72d7-4629-a681-70626c1029d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1200cd63afa4175a61e9b5613680143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:06Z,use_quota=True,user_id='ed760878836741cfbbac0f719e81272b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Creating volume e3a6d6f4-72d7-4629-a681-70626c1029d9 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:30:08 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:08 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3" returned: 0 in 0.431s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:08 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9 1073741824 Aug 05 10:30:08 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:08 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-3255c258-9e08-4cc9-a01f-5a0aae579ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Create snapshot completed successfully Aug 05 10:30:08 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48 Aug 05 10:30:08 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:08 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722" returned: 0 in 0.401s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:08 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722 Aug 05 10:30:08 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:09 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:09 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48" returned: 0 in 0.379s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b836fdf-8ca1-40ff-b721-444ff5b2b722" returned: 0 in 0.277s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] Lock "cinder-quobyte-0b836fdf-8ca1-40ff-b721-444ff5b2b722" released by "delete_volume" :: held 0.731s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:09 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48 Aug 05 10:30:09 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:09 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] Created reservations ['a45b6907-0cec-4a31-96b9-1bc005040b3c', 'd3ef6219-71ab-482e-a81e-03a302163c5f', '1ed977ee-a8df-41d1-b8d8-a2c6deead1fb', 'bbc2ab2f-acd7-430c-8993-39855242b1da'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9 1073741824" returned: 0 in 0.480s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:09 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9 Aug 05 10:30:09 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:09 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:30:09 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:09 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3.3c720229-3427-4e21-99d6-c7e1a2a2db48" returned: 0 in 0.293s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-3c720229-3427-4e21-99d6-c7e1a2a2db48" released by "_delete_snapshot" :: held 1.696s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-43e93c4c-7e15-4850-beff-cd4e483290a3" released by "delete_snapshot" :: held 1.737s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "cinder-quobyte-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "cinder-quobyte-65dd007c-4843-48ef-819b-b760e5e51f66" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-65dd007c-4843-48ef-819b-b760e5e51f66" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:09 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Deleting offline snapshot 65dd007c-4843-48ef-819b-b760e5e51f66 of volume bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] snapshot_file for this snap is: volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9" returned: 0 in 0.336s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b5d9b3-f425-4710-94fc-cc2ea608c3d9]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:09 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad156398-c43e-440a-ac46-e62b46fb0a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a6d6f4-72d7-4629-a681-70626c1029d9', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dba91cb-2f95-4433-9d76-ee8612177db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.335s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:30:09 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] Deleted volume successfully. Aug 05 10:30:09 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Volume volume-e3a6d6f4-72d7-4629-a681-70626c1029d9 (e3a6d6f4-72d7-4629-a681-70626c1029d9): created successfully Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dba91cb-2f95-4433-9d76-ee8612177db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Flow 'volume_create_manager' (aafee03f-d2fe-4157-8108-293fba66185b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:09 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c731f894-2c64-4ae7-ab7e-0903fa2fd1af tempest-VolumesSnapshotTestJSON-182025420 None] Created volume successfully. Aug 05 10:30:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1bbd9825-6ecb-4042-b3b7-7e20817b173d tempest-ServerActionsTestOtherA-983179334 None] Lock "cinder-0b836fdf-8ca1-40ff-b721-444ff5b2b722-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:09 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66 Aug 05 10:30:09 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:10 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66" returned: 0 in 0.556s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d29635d-2788-4fb4-8a40-222606dae48d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] Creating offline snapshot daa2adb8-f05c-4967-b5bc-ec3620d712ba of volume e3a6d6f4-72d7-4629-a681-70626c1029d9 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[92485bcc-2f0f-4c93-8e81-ae46d60d15b6]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:10 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 Aug 05 10:30:10 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:10 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9 Aug 05 10:30:10 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Acquiring lock "cinder-8616b795-0efe-49e1-b570-db3a9ba4c8f0-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:10 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9" returned: 0 in 0.632s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "cinder-8616b795-0efe-49e1-b570-db3a9ba4c8f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Acquiring lock "cinder-quobyte-fdc0c412-a109-4f88-a594-b68ab0c30194" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "cinder-quobyte-fdc0c412-a109-4f88-a594-b68ab0c30194" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Acquiring lock "cinder-quobyte-8616b795-0efe-49e1-b570-db3a9ba4c8f0" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:10 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:10 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66 Aug 05 10:30:10 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9" returned: 0 in 0.524s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "cinder-quobyte-8616b795-0efe-49e1-b570-db3a9ba4c8f0" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Deleting offline snapshot 8616b795-0efe-49e1-b570-db3a9ba4c8f0 of volume fdc0c412-a109-4f88-a594-b68ab0c30194 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:30:11 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba 1G Aug 05 10:30:11 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] snapshot_file for this snap is: volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:30:11 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61c1c9f-3fa9-4081-a1ae-e2cc9c56ee36]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:11 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0 Aug 05 10:30:11 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:11 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66" returned: 0 in 0.586s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:11 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66 Aug 05 10:30:11 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:11 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0" returned: 0 in 0.645s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdc0c412-a109-4f88-a594-b68ab0c30194(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:30:11 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba 1G" returned: 0 in 0.780s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a6d6f4-72d7-4629-a681-70626c1029d9 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:11 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5463277-dafb-4235-aff9-2302e3ff799d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:11 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a6d6f4-72d7-4629-a681-70626c1029d9 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba Aug 05 10:30:11 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:11 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9.65dd007c-4843-48ef-819b-b760e5e51f66" returned: 0 in 0.406s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:11 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194 Aug 05 10:30:11 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-65dd007c-4843-48ef-819b-b760e5e51f66" released by "_delete_snapshot" :: held 2.351s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9" released by "delete_snapshot" :: held 2.387s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:12 devstack cinder-volume[88736]: WARNING cinder.quota [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-391631152 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-391631152, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:30:12 devstack cinder-volume[88736]: WARNING cinder.quota [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-391631152 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-391631152, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:30:12 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Created reservations ['06e9f979-4460-4f53-81ce-aed2dbf82652', '6dcc29f2-280f-4fc4-811f-776351931a9f', 'f9077360-2f50-43bb-95cd-9cc43f7684b5', 'bd830a85-255b-40a4-8ff6-8fa2ce6c23ff'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:12 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a6d6f4-72d7-4629-a681-70626c1029d9 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba" returned: 0 in 0.421s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:12 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba is being set with open permissions: ugo+rw Aug 05 10:30:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:12 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba Aug 05 10:30:12 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:12 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194" returned: 0 in 0.468s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:12 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0 Aug 05 10:30:12 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:12 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] Created reservations ['4024fd6a-aac7-44af-813d-8f526d1aa9ee', '92c156f9-7ce9-4289-b54b-d9a04a0df996', '18b7d071-ab3f-4521-a783-91fbe79a7f7e', '40d6a350-1ac6-453e-b9c8-d7f70087da99'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:12 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d3903b5e-3674-4a84-aef0-011af602a91b tempest-GroupSnapshotsTest-1753681046 None] group_snapshot 2948bed2-8406-412f-858c-950cd962336f: deleted successfully Aug 05 10:30:12 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba" returned: 0 in 0.336s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:12 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.info Aug 05 10:30:12 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:12 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0" returned: 0 in 0.375s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:12 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0 Aug 05 10:30:12 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:12 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.info" returned: 0 in 0.251s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:12 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.info is being set with open permissions: ugo+rw Aug 05 10:30:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:12 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.info Aug 05 10:30:12 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:12 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194.8616b795-0efe-49e1-b570-db3a9ba4c8f0" returned: 0 in 0.250s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "cinder-quobyte-8616b795-0efe-49e1-b570-db3a9ba4c8f0" released by "_delete_snapshot" :: held 1.915s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "cinder-quobyte-fdc0c412-a109-4f88-a594-b68ab0c30194" released by "delete_snapshot" :: held 1.961s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:12 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Created reservations ['5d2ec478-902e-4e31-9f88-31be3b6e4036', 'e652beb8-949f-4e84-80f8-2f1081ffca64', '6374d3ce-55b5-443b-be9d-4603fc8959ba', 'bc409fa2-8ff3-4ce0-8bd6-09ada62b7f18'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:13 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Delete snapshot completed successfully. Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7b7aba4b-9cc5-48cd-ab1a-9f4a1b302720 tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "cinder-8616b795-0efe-49e1-b570-db3a9ba4c8f0-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:13 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.info" returned: 0 in 0.301s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.799s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:13 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-337e6aa2-c290-46ad-bfed-2de6c73664b4 tempest-VolumesSnapshotTestJSON-182025420 None] Create snapshot completed successfully Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-daa2adb8-f05c-4967-b5bc-ec3620d712ba-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-daa2adb8-f05c-4967-b5bc-ec3620d712ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-quobyte-e3a6d6f4-72d7-4629-a681-70626c1029d9" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-e3a6d6f4-72d7-4629-a681-70626c1029d9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-quobyte-daa2adb8-f05c-4967-b5bc-ec3620d712ba" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-daa2adb8-f05c-4967-b5bc-ec3620d712ba" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] Deleting offline snapshot daa2adb8-f05c-4967-b5bc-ec3620d712ba of volume e3a6d6f4-72d7-4629-a681-70626c1029d9 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] snapshot_file for this snap is: volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcb727a-49dc-4b49-bcaf-e69eb753feba]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:13 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba Aug 05 10:30:13 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:13 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:30:13 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "cinder-quobyte-43e93c4c-7e15-4850-beff-cd4e483290a3" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-43e93c4c-7e15-4850-beff-cd4e483290a3" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:13 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7052bee-7418-4cdb-857a-f1e68669a7bf]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:14 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3 Aug 05 10:30:14 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:14 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Acquiring lock "cinder-fdc0c412-a109-4f88-a594-b68ab0c30194-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.407s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "cinder-fdc0c412-a109-4f88-a594-b68ab0c30194-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:14 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba" returned: 0 in 0.545s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3a6d6f4-72d7-4629-a681-70626c1029d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[94592555-51d0-44f2-8c5b-8a2b584d3590]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Acquiring lock "cinder-quobyte-fdc0c412-a109-4f88-a594-b68ab0c30194" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "cinder-quobyte-fdc0c412-a109-4f88-a594-b68ab0c30194" acquired by "delete_volume" :: waited 0.033s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:14 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3" returned: 0 in 0.468s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3493b090-e16c-4e76-92c4-839713751875]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:14 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9 Aug 05 10:30:14 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:14 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3 Aug 05 10:30:14 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:14 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194 Aug 05 10:30:14 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:14 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:14 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-43e93c4c-7e15-4850-beff-cd4e483290a3" returned: 0 in 0.338s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9" returned: 0 in 0.474s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-43e93c4c-7e15-4850-beff-cd4e483290a3" released by "delete_volume" :: held 0.914s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "cinder-quobyte-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:14 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba Aug 05 10:30:14 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9" acquired by "delete_volume" :: waited 0.024s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:14 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194" returned: 0 in 0.431s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3007a0a7-c521-4b9e-ba86-644f99280d02]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:14 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194 Aug 05 10:30:14 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:15 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 Aug 05 10:30:15 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:15 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fdc0c412-a109-4f88-a594-b68ab0c30194" returned: 0 in 0.297s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "cinder-quobyte-fdc0c412-a109-4f88-a594-b68ab0c30194" released by "delete_volume" :: held 0.811s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:15 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba" returned: 0 in 0.447s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:15 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba Aug 05 10:30:15 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Created reservations ['0ac8f95f-8f68-43e0-b192-e1f437713fc7', '6c92ae59-d66e-40ee-a0a6-cf96e61cfd9d', '219dac1b-5e4c-4698-997a-e7c26b28415e', '35039d02-8ce5-4371-b7c2-27449c60915e'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:15 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9" returned: 0 in 0.555s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:15 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:30:15 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:15 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9 Aug 05 10:30:15 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:15 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9.daa2adb8-f05c-4967-b5bc-ec3620d712ba" returned: 0 in 0.361s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-daa2adb8-f05c-4967-b5bc-ec3620d712ba" released by "_delete_snapshot" :: held 1.958s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-e3a6d6f4-72d7-4629-a681-70626c1029d9" released by "delete_snapshot" :: held 1.991s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:15 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.272s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:30:15 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Deleted volume successfully. Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-364f5365-3251-493d-9eb7-45ef5d31da3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1277609650 None] Lock "cinder-fdc0c412-a109-4f88-a594-b68ab0c30194-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] Created reservations ['4d6cf97a-069b-4382-b822-d7054a31c717', '1706c538-d344-49b3-9bfb-7b95a412ad39', '293c4f28-ddf5-4a16-831f-94a195975043', '34c94281-0d02-4ef4-bb22-9b7499f8fc6e'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:15 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9" returned: 0 in 0.332s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-bdb2d1f8-ca97-464e-ab8a-4a78ceef74d9" released by "delete_volume" :: held 0.972s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:15 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] Delete snapshot completed successfully. Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ec96ee2-d082-40e7-8e90-01b07ee9f501 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-daa2adb8-f05c-4967-b5bc-ec3620d712ba-delete_snapshot" released by "delete_snapshot" :: held 2.217s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Created reservations ['e72b925c-f20c-4407-9e18-d00c46f039aa'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:15 devstack cinder-volume[88736]: WARNING cinder.quota [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-391631152 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-391631152, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:30:15 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Created reservations ['b5787f94-f9af-4e11-a4ae-3b4453d71aa4', 'e016d1d0-2ddd-4063-863b-fa8146bb2be2', '7017a0cd-8658-438d-ad76-3848c83336c6', '60a519f3-17f7-447c-a906-034c57de2023'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:16 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Created reservations ['a95f2790-7e5a-4b0d-9107-ae115ae712dc', 'a4567b67-66b8-4c3b-9085-c4b566bd012c', 'a0b7f895-97fd-44c9-b09b-60c80ad2a97f', '0275b6c7-01cf-4c2b-8b7b-3bc3b7c78727'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:16 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:16 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:16 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:30:16 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:16 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.318s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:16 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:30:16 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b4e22dc5-7e53-488f-925b-df62c310c6dc tempest-GroupSnapshotsTest-1753681046 None] Delete group completed successfully. Aug 05 10:30:17 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a33906e6-6467-4c16-b98e-76bfb982f57f tempest-GroupSnapshotsTest-1753681046 None] Group tempest-GroupSnapshotsTest-Group-1915413647: creating Aug 05 10:30:17 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a33906e6-6467-4c16-b98e-76bfb982f57f tempest-GroupSnapshotsTest-1753681046 None] Group tempest-GroupSnapshotsTest-Group-1915413647: created successfully Aug 05 10:30:17 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a33906e6-6467-4c16-b98e-76bfb982f57f tempest-GroupSnapshotsTest-1753681046 None] Create group completed successfully. Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Flow 'volume_create_manager' (271ef0a4-dd04-4df7-a653-f8ee7c20d110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2b1bad-8a11-451b-ae28-c815d278d840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2b1bad-8a11-451b-ae28-c815d278d840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1073390455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3577700-c84d-4aef-b61f-28e01bb025d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1200cd63afa4175a61e9b5613680143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:17Z,use_quota=True,user_id='ed760878836741cfbbac0f719e81272b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57aeb3f5-a120-43b8-88a0-3a4df06a755d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57aeb3f5-a120-43b8-88a0-3a4df06a755d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19192e03-430d-4081-8907-8b7cfab542f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19192e03-430d-4081-8907-8b7cfab542f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3577700-c84d-4aef-b61f-28e01bb025d2', 'volume_name': 'volume-e3577700-c84d-4aef-b61f-28e01bb025d2', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59329ee5-7ff1-4073-87ea-c544a48d3786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59329ee5-7ff1-4073-87ea-c544a48d3786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454b5171-6c6c-4f63-87fb-c2dac71499a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:17 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Volume e3577700-c84d-4aef-b61f-28e01bb025d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3577700-c84d-4aef-b61f-28e01bb025d2', 'volume_size': 1} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1073390455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3577700-c84d-4aef-b61f-28e01bb025d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1200cd63afa4175a61e9b5613680143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:17Z,use_quota=True,user_id='ed760878836741cfbbac0f719e81272b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Creating volume e3577700-c84d-4aef-b61f-28e01bb025d2 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:30:17 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:30:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:17 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 1073741824 Aug 05 10:30:17 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:18 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 1073741824" returned: 0 in 0.609s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:18 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 Aug 05 10:30:18 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:18 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2" returned: 0 in 0.337s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454b5171-6c6c-4f63-87fb-c2dac71499a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3577700-c84d-4aef-b61f-28e01bb025d2', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f8e42b-1dad-4773-99f0-1822003d29ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:18 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Volume volume-e3577700-c84d-4aef-b61f-28e01bb025d2 (e3577700-c84d-4aef-b61f-28e01bb025d2): created successfully Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f8e42b-1dad-4773-99f0-1822003d29ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Flow 'volume_create_manager' (271ef0a4-dd04-4df7-a653-f8ee7c20d110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:18 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-695c6ec5-4b7e-46d5-870c-31fed02b6f87 tempest-VolumesSnapshotTestJSON-182025420 None] Created volume successfully. Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Flow 'volume_create_manager' (e09321cf-c998-44d0-bee6-73d03f47ffcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b153514-cde8-4328-9bfe-346fab8c685b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b153514-cde8-4328-9bfe-346fab8c685b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-912957308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b0d51d3-4fbe-4e4b-bd78-dc300a63e446,host='devstack@QuobyteHD#QuobyteHD',id=306ac84f-47e5-47c3-a2ca-f31d3b88104c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5faedda4ed74ed2a21252af374d1296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:19Z,use_quota=True,user_id='2a11aac3337445aeafd061523963668e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bad442a1-5638-4cee-8c88-b1135ef6134f),volume_type_id=bad442a1-5638-4cee-8c88-b1135ef6134f)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0edac8-c0bf-492a-a0a2-039cee222801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0edac8-c0bf-492a-a0a2-039cee222801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e041e5e5-5548-424b-873e-dc0e65d612a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e041e5e5-5548-424b-873e-dc0e65d612a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '306ac84f-47e5-47c3-a2ca-f31d3b88104c', 'volume_name': 'volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020acf96-9f39-4a16-87ef-7eafca7eca73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020acf96-9f39-4a16-87ef-7eafca7eca73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1482920-f2bb-421d-912c-d7b00795434f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:18 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Volume 306ac84f-47e5-47c3-a2ca-f31d3b88104c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c', 'volume_size': 1} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6b0d51d3-4fbe-4e4b-bd78-dc300a63e446,created_at=2026-08-05T08:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-912957308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b0d51d3-4fbe-4e4b-bd78-dc300a63e446,host='devstack@QuobyteHD#QuobyteHD',id=306ac84f-47e5-47c3-a2ca-f31d3b88104c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5faedda4ed74ed2a21252af374d1296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:19Z,use_quota=True,user_id='2a11aac3337445aeafd061523963668e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bad442a1-5638-4cee-8c88-b1135ef6134f),volume_type_id=bad442a1-5638-4cee-8c88-b1135ef6134f)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Creating volume 306ac84f-47e5-47c3-a2ca-f31d3b88104c {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:30:18 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:30:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:19 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c 1073741824 Aug 05 10:30:19 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:19 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c 1073741824" returned: 0 in 0.525s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:19 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c Aug 05 10:30:19 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:19 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c" returned: 0 in 0.328s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:30:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1482920-f2bb-421d-912c-d7b00795434f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb51b50-22ba-41ad-9116-05fa9e1cd1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] Creating offline snapshot 1f687de6-4659-44a7-8de8-c05867f5a44b of volume e3577700-c84d-4aef-b61f-28e01bb025d2 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:30:19 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Volume volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c (306ac84f-47e5-47c3-a2ca-f31d3b88104c): created successfully Aug 05 10:30:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb51b50-22ba-41ad-9116-05fa9e1cd1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Flow 'volume_create_manager' (e09321cf-c998-44d0-bee6-73d03f47ffcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:19 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0951a22b-b40a-4108-a09d-6f54f5dfc82a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:20 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-973f85c7-65fd-4ae0-8313-00526ab4a61f tempest-GroupSnapshotsTest-1753681046 None] Created volume successfully. Aug 05 10:30:20 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 Aug 05 10:30:20 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:20 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2" returned: 0 in 0.469s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:20 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b 1G Aug 05 10:30:20 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:20 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] GroupSnapshot 99c105ba-eda4-4f62-83c3-da7bbb4e09d1: creating. Aug 05 10:30:20 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] Group snapshot 99c105ba-eda4-4f62-83c3-da7bbb4e09d1: creating. {{(pid=88736) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 10:30:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:20 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b 1G" returned: 0 in 0.521s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3577700-c84d-4aef-b61f-28e01bb025d2 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:21 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3577700-c84d-4aef-b61f-28e01bb025d2 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b Aug 05 10:30:21 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:21 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3577700-c84d-4aef-b61f-28e01bb025d2 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b" returned: 0 in 0.353s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:21 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b is being set with open permissions: ugo+rw Aug 05 10:30:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:21 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b Aug 05 10:30:21 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:21 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b" returned: 0 in 0.286s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:21 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.info Aug 05 10:30:21 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:21 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.info" returned: 0 in 0.299s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:21 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.info is being set with open permissions: ugo+rw Aug 05 10:30:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:21 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.info Aug 05 10:30:21 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:22 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.info" returned: 0 in 0.303s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.664s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] Creating offline snapshot 76a8fafb-4796-4b3e-872d-d6abd09824c2 of volume 306ac84f-47e5-47c3-a2ca-f31d3b88104c {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:30:22 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-fac96d96-31d6-4370-bc93-a552b2b507a8 tempest-VolumesSnapshotTestJSON-182025420 None] Create snapshot completed successfully Aug 05 10:30:22 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71ab99c-36a5-41a6-b4d8-e73936afaa74]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:22 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c Aug 05 10:30:22 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:22 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c" returned: 0 in 0.412s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:22 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2 1G Aug 05 10:30:22 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:23 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2 1G" returned: 0 in 0.629s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:23 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2 Aug 05 10:30:23 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:23 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2" returned: 0 in 0.419s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:23 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:30:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:23 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2 Aug 05 10:30:23 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:23 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:30:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Flow 'volume_create_manager' (cfff3eb8-c3e1-47cb-a888-cb8a3acf55c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21431da6-1d05-469d-9616-8dcb9a002d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21431da6-1d05-469d-9616-8dcb9a002d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-569206503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f072087e-8b28-4ab7-86a0-82d6ec4edc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1200cd63afa4175a61e9b5613680143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1f687de6-4659-44a7-8de8-c05867f5a44b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:24Z,use_quota=True,user_id='ed760878836741cfbbac0f719e81272b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31d077b-96d4-4e35-90d8-b884bb2ae1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31d077b-96d4-4e35-90d8-b884bb2ae1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9350876-c676-4c74-af73-e6230c526325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9350876-c676-4c74-af73-e6230c526325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f072087e-8b28-4ab7-86a0-82d6ec4edc6b', 'volume_name': 'volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b', 'volume_size': 2, 'snapshot_id': '1f687de6-4659-44a7-8de8-c05867f5a44b'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7122774b-8ec9-4ea8-8579-3b7271eb8ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7122774b-8ec9-4ea8-8579-3b7271eb8ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fdf15f-a5cc-430b-bdfd-43382ee14d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:23 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Volume f072087e-8b28-4ab7-86a0-82d6ec4edc6b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b', 'volume_size': 2, 'snapshot_id': '1f687de6-4659-44a7-8de8-c05867f5a44b'} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:30:24 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Flow 'volume_create_manager' (39caefea-8aa6-41ad-b207-38b1d283b1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3c1155-ecb2-4129-b277-6e873a9e83dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2" returned: 0 in 0.389s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3c1155-ecb2-4129-b277-6e873a9e83dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-664939778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9b4cbaf65744c4a35ad3bd95689954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:24Z,use_quota=True,user_id='3cc46ce2eade4924b2851d305c712029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30032f67-4b36-42a8-b272-ff16d59470b3),volume_type_id=30032f67-4b36-42a8-b272-ff16d59470b3)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf12eaa-1160-427d-88bd-31c4e1adb78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf12eaa-1160-427d-88bd-31c4e1adb78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e41f46-e815-41ef-a6e2-0622071bc6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e41f46-e815-41ef-a6e2-0622071bc6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b', 'volume_name': 'volume-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd39923d-1595-4755-af63-a8c025a61a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd39923d-1595-4755-af63-a8c025a61a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e2ba0a-f614-41fb-9756-b103a4700990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:24 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Volume bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b', 'volume_size': 1} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:24 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.info Aug 05 10:30:24 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:24 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.info" returned: 0 in 0.261s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:24 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:24 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.info Aug 05 10:30:24 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:24 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.info" returned: 0 in 0.265s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.526s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.823s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-quobyte-1f687de6-4659-44a7-8de8-c05867f5a44b-f072087e-8b28-4ab7-86a0-82d6ec4edc6b" by "_create_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-1f687de6-4659-44a7-8de8-c05867f5a44b-f072087e-8b28-4ab7-86a0-82d6ec4edc6b" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Creating volume f072087e-8b28-4ab7-86a0-82d6ec4edc6b from snapshot 1f687de6-4659-44a7-8de8-c05867f5a44b {{(pid=88736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-quobyte-f072087e-8b28-4ab7-86a0-82d6ec4edc6b" by "_copy_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-f072087e-8b28-4ab7-86a0-82d6ec4edc6b" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] snapshot: 1f687de6-4659-44a7-8de8-c05867f5a44b, volume: f072087e-8b28-4ab7-86a0-82d6ec4edc6b, {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc098d4d-c32d-4562-a55f-9d2477e35c21]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:24 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ae4fd326-a1a9-43dc-93d7-f5fc582d88a6 tempest-GroupSnapshotsTest-1753681046 None] group_snapshot 99c105ba-eda4-4f62-83c3-da7bbb4e09d1: created successfully Aug 05 10:30:25 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b Aug 05 10:30:25 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:25 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b" returned: 0 in 0.417s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3577700-c84d-4aef-b61f-28e01bb025d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:30:25 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5964724-642b-4f6e-bcc6-3eca8daea5c4]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:25 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 Aug 05 10:30:25 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:25 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2" returned: 0 in 0.488s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] will copy from snapshot at /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:30:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Creating direct copy from snapshot {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:30:25 devstack cinder-volume[88736]: DEBUG cinder.utils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Path /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b not found in is_blk_device check {{(pid=88736) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:30:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:25 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b Aug 05 10:30:25 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:26 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] group_snapshot 99c105ba-eda4-4f62-83c3-da7bbb4e09d1: deleting Aug 05 10:30:26 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] group_snapshot 99c105ba-eda4-4f62-83c3-da7bbb4e09d1: deleting {{(pid=88736) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 10:30:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "cinder-quobyte-306ac84f-47e5-47c3-a2ca-f31d3b88104c" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-306ac84f-47e5-47c3-a2ca-f31d3b88104c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "cinder-quobyte-76a8fafb-4796-4b3e-872d-d6abd09824c2" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-76a8fafb-4796-4b3e-872d-d6abd09824c2" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:26 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] Deleting offline snapshot 76a8fafb-4796-4b3e-872d-d6abd09824c2 of volume 306ac84f-47e5-47c3-a2ca-f31d3b88104c {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:30:26 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] snapshot_file for this snap is: volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:30:26 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6217045f-704c-4106-814e-db15e87c1758]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:26 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2 Aug 05 10:30:26 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:27 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2" returned: 0 in 1.220s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:27 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:30:27 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cd5730-b40a-48e6-acc4-8a8d74a399d0]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:27 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c Aug 05 10:30:27 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:28 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c" returned: 0 in 0.887s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:28 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2 Aug 05 10:30:28 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:29 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2" returned: 0 in 1.279s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:29 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2 Aug 05 10:30:29 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:30 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c.76a8fafb-4796-4b3e-872d-d6abd09824c2" returned: 0 in 0.913s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-76a8fafb-4796-4b3e-872d-d6abd09824c2" released by "_delete_snapshot" :: held 4.543s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-306ac84f-47e5-47c3-a2ca-f31d3b88104c" released by "delete_snapshot" :: held 4.589s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:31 devstack cinder-volume[88736]: WARNING cinder.quota [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1131188223 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1131188223, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:30:31 devstack cinder-volume[88736]: WARNING cinder.quota [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1131188223 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1131188223, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:30:31 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] Created reservations ['2a534f17-cc5e-4968-97bb-dc7129cf749e', '855162fd-4dfb-48e5-9732-3fa004c91cc8', '24f18f87-7adc-469c-be9a-5a9917b50454', 'bc6d8cf3-084e-4271-9b5b-5c3ed172df73'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:31 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-985dbf52-0f31-4df2-8b9f-cc36bc098c8e tempest-GroupSnapshotsTest-1753681046 None] group_snapshot 99c105ba-eda4-4f62-83c3-da7bbb4e09d1: deleted successfully Aug 05 10:30:31 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b" returned: 0 in 5.915s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:31 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Image conversion details: src /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:30:31 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Converted 1024.00 MB image at 173.10 MB/s Aug 05 10:30:31 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b is being set with open permissions: ugo+rw Aug 05 10:30:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:31 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b Aug 05 10:30:31 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:32 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b" returned: 0 in 0.331s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-f072087e-8b28-4ab7-86a0-82d6ec4edc6b" released by "_copy_volume_from_snapshot" :: held 7.244s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-1f687de6-4659-44a7-8de8-c05867f5a44b-f072087e-8b28-4ab7-86a0-82d6ec4edc6b" released by "_create_volume_from_snapshot" :: held 7.327s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.356s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.945s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-664939778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9b4cbaf65744c4a35ad3bd95689954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:24Z,use_quota=True,user_id='3cc46ce2eade4924b2851d305c712029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30032f67-4b36-42a8-b272-ff16d59470b3),volume_type_id=30032f67-4b36-42a8-b272-ff16d59470b3)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Creating volume bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:30:32 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:32 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b 1073741824 Aug 05 10:30:32 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fdf15f-a5cc-430b-bdfd-43382ee14d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b', 'volume_size': 2, 'snapshot_id': '1f687de6-4659-44a7-8de8-c05867f5a44b'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d005d5a4-1bb5-46bf-a25c-bb6bebdae598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:32 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Volume volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b (f072087e-8b28-4ab7-86a0-82d6ec4edc6b): created successfully Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d005d5a4-1bb5-46bf-a25c-bb6bebdae598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Flow 'volume_create_manager' (cfff3eb8-c3e1-47cb-a888-cb8a3acf55c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "cinder-quobyte-306ac84f-47e5-47c3-a2ca-f31d3b88104c" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:32 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-5bb7989a-e5ca-4bfd-8a25-d422967bdec0 tempest-VolumesSnapshotTestJSON-182025420 None] Created volume successfully. Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-306ac84f-47e5-47c3-a2ca-f31d3b88104c" acquired by "delete_volume" :: waited 0.034s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e2fc63-600f-4b68-b815-ef825ed9e7a2]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:32 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c Aug 05 10:30:32 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:32 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b 1073741824" returned: 0 in 0.563s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:32 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b Aug 05 10:30:32 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:32 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c" returned: 0 in 0.456s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:32 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c Aug 05 10:30:32 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-f072087e-8b28-4ab7-86a0-82d6ec4edc6b-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-f072087e-8b28-4ab7-86a0-82d6ec4edc6b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-quobyte-f072087e-8b28-4ab7-86a0-82d6ec4edc6b" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-f072087e-8b28-4ab7-86a0-82d6ec4edc6b" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:33 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b" returned: 0 in 0.366s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e2ba0a-f614-41fb-9756-b103a4700990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c597a8-99e6-419f-8833-48c4c1e5f66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63b73a6-5ad5-415d-a87a-36c9edf09277]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:33 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-306ac84f-47e5-47c3-a2ca-f31d3b88104c" returned: 0 in 0.320s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:33 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Volume volume-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b (bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b): created successfully Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c597a8-99e6-419f-8833-48c4c1e5f66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Flow 'volume_create_manager' (39caefea-8aa6-41ad-b207-38b1d283b1b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] Lock "cinder-quobyte-306ac84f-47e5-47c3-a2ca-f31d3b88104c" released by "delete_volume" :: held 0.863s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:33 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7d8272a8-d689-4912-a08b-7023d866f091 tempest-VolumeTypesAccessTest-96813919 None] Created volume successfully. Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] Created reservations ['e0bf358d-c048-47b4-884d-f83596d18955'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:33 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b Aug 05 10:30:33 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:33 devstack cinder-volume[88736]: WARNING cinder.quota [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1131188223 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1131188223, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] Created reservations ['8fd68500-60a7-4e62-9dea-9d9685b8959e', '73627453-a07c-4f5f-9398-750523337dbc', 'b5a000ac-b95f-45a9-879a-e1d02f2072fb', 'e6c93f94-b994-4505-8c16-f1326503230d'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:33 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:30:33 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:33 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b" returned: 0 in 0.444s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:33 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b Aug 05 10:30:33 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:33 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.329s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:30:33 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-6ef79954-6177-4117-975d-3fb8f2d277d7 tempest-GroupSnapshotsTest-1753681046 None] Delete group completed successfully. Aug 05 10:30:33 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f072087e-8b28-4ab7-86a0-82d6ec4edc6b" returned: 0 in 0.310s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-f072087e-8b28-4ab7-86a0-82d6ec4edc6b" released by "delete_volume" :: held 0.833s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] Created reservations ['58dc154a-48c6-4028-9718-00a8250d28bf', '94155330-5c0c-4538-a08c-061d9970a710', '92506954-7263-42c6-9838-a641cd9de936', 'b7c3994a-28b2-4f8c-b8fd-55fc4ddc5f8e'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:34 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:30:34 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Acquiring lock "cinder-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Lock "cinder-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-1f687de6-4659-44a7-8de8-c05867f5a44b-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-1f687de6-4659-44a7-8de8-c05867f5a44b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-quobyte-e3577700-c84d-4aef-b61f-28e01bb025d2" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Acquiring lock "cinder-quobyte-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-e3577700-c84d-4aef-b61f-28e01bb025d2" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-quobyte-1f687de6-4659-44a7-8de8-c05867f5a44b" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Lock "cinder-quobyte-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b" acquired by "delete_volume" :: waited 0.035s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:34 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.470s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-1f687de6-4659-44a7-8de8-c05867f5a44b" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] Deleting offline snapshot 1f687de6-4659-44a7-8de8-c05867f5a44b of volume e3577700-c84d-4aef-b61f-28e01bb025d2 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] snapshot_file for this snap is: volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2c35af-40eb-4912-b889-3e9b29871755]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd1c240-ed69-4414-96e9-54448215009a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:34 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] Deleted volume successfully. Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1ee96a5f-e2f4-4a1a-b081-8d847a5ff69c tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-f072087e-8b28-4ab7-86a0-82d6ec4edc6b-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:34 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b Aug 05 10:30:34 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:34 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b Aug 05 10:30:34 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:35 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b" returned: 0 in 0.514s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3577700-c84d-4aef-b61f-28e01bb025d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:30:35 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b" returned: 0 in 0.558s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:35 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[909e5daf-64b6-4372-b91e-e269aab67351]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:35 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b Aug 05 10:30:35 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:35 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 Aug 05 10:30:35 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:35 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b" returned: 0 in 0.321s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:35 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Lock "cinder-quobyte-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b" released by "delete_volume" :: held 0.995s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:35 devstack cinder-volume[88736]: WARNING cinder.quota [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1876848823 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1876848823, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:30:35 devstack cinder-volume[88736]: WARNING cinder.quota [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1876848823 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1876848823, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:30:35 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Created reservations ['3d7ebf27-4bc2-4b3d-b6fe-cc2254e0c7c4', '69466ab8-65cf-4db1-97c1-4819443bb2d4', '4a34f6c7-2d37-4dc3-ab02-f29a7f859f59', '38781d52-942c-4bc2-91f2-bee929372531'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:35 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:30:35 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:35 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2" returned: 0 in 0.739s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:36 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:36 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b Aug 05 10:30:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.310s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:36 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:36 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:30:36 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Deleted volume successfully. Aug 05 10:30:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ef6d8bb-9aba-47c6-a719-4388387fc44f tempest-VolumeTypesAccessTest-96813919 None] Lock "cinder-bd0caac5-01b4-4cb0-a31f-b7a06cb66b3b-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:36 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b" returned: 0 in 0.444s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:36 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b Aug 05 10:30:36 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:36 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2.1f687de6-4659-44a7-8de8-c05867f5a44b" returned: 0 in 0.288s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-1f687de6-4659-44a7-8de8-c05867f5a44b" released by "_delete_snapshot" :: held 2.150s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-e3577700-c84d-4aef-b61f-28e01bb025d2" released by "delete_snapshot" :: held 2.226s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:36 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] Created reservations ['bca3a61d-6410-4977-be59-b097eb9a375c', '41d81dd9-7413-4a76-8854-ba4a667f7d41', 'd9c5e68c-b66e-4748-9325-17171e08bb85', '3eb39eb6-1b9a-4925-ad00-f0bad818534b'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:36 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] Delete snapshot completed successfully. Aug 05 10:30:37 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d9279e11-d2d9-4b87-8021-c3ead89b9464 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-1f687de6-4659-44a7-8de8-c05867f5a44b-delete_snapshot" released by "delete_snapshot" :: held 2.452s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:37 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-e3577700-c84d-4aef-b61f-28e01bb025d2-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:37 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-e3577700-c84d-4aef-b61f-28e01bb025d2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:37 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-quobyte-e3577700-c84d-4aef-b61f-28e01bb025d2" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:37 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-e3577700-c84d-4aef-b61f-28e01bb025d2" acquired by "delete_volume" :: waited 0.035s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:37 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[195e7d35-365a-42aa-bcde-56fe6ebcbdc1]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:38 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 Aug 05 10:30:38 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:38 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2" returned: 0 in 0.556s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:38 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2 Aug 05 10:30:38 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:38 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3577700-c84d-4aef-b61f-28e01bb025d2" returned: 0 in 0.366s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:38 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-e3577700-c84d-4aef-b61f-28e01bb025d2" released by "delete_volume" :: held 1.036s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:39 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] Created reservations ['744d0cc0-65f0-43be-b631-9faffa4156ad', '65ded577-f6e3-43b3-ad04-078298a4e4dc', 'b61d15fd-5952-43ed-9678-f001ef0a7427', '5d7ab3fb-dcd9-4dd6-87e2-92b2ce7d9709'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:30:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:39 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:30:39 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:39 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.364s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:39 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:30:39 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] Deleted volume successfully. Aug 05 10:30:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2524ce57-ea26-4783-bf23-571a9ff00423 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-e3577700-c84d-4aef-b61f-28e01bb025d2-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Flow 'volume_create_manager' (d9a29ce7-0783-49e3-9128-5f29df2516eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ab2565-91e3-4a77-82f4-83f32a928234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ab2565-91e3-4a77-82f4-83f32a928234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1162194447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b9f785-69f1-4b79-81c3-325288aedcb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1200cd63afa4175a61e9b5613680143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:41Z,use_quota=True,user_id='ed760878836741cfbbac0f719e81272b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84de9e0-cd91-4d82-98f4-c6af62c05d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84de9e0-cd91-4d82-98f4-c6af62c05d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e6fab8-e0ac-4962-aaef-cb04385fc196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e6fab8-e0ac-4962-aaef-cb04385fc196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3b9f785-69f1-4b79-81c3-325288aedcb1', 'volume_name': 'volume-a3b9f785-69f1-4b79-81c3-325288aedcb1', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f009f25d-962e-4f4d-8d99-b9ece7c08725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f009f25d-962e-4f4d-8d99-b9ece7c08725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369b0c7e-6455-4d34-9521-08c75db89ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:41 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Volume a3b9f785-69f1-4b79-81c3-325288aedcb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3b9f785-69f1-4b79-81c3-325288aedcb1', 'volume_size': 1} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1162194447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b9f785-69f1-4b79-81c3-325288aedcb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1200cd63afa4175a61e9b5613680143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:41Z,use_quota=True,user_id='ed760878836741cfbbac0f719e81272b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Creating volume a3b9f785-69f1-4b79-81c3-325288aedcb1 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:30:41 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:30:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:41 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 1073741824 Aug 05 10:30:41 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:42 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-4488be34-f312-45e4-a21e-e4372f0300d3 tempest-GroupSnapshotsV319Test-48001631 None] Group tempest-GroupSnapshotsV319Test-Group-939763332: creating Aug 05 10:30:42 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-4488be34-f312-45e4-a21e-e4372f0300d3 tempest-GroupSnapshotsV319Test-48001631 None] Group tempest-GroupSnapshotsV319Test-Group-939763332: created successfully Aug 05 10:30:42 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-4488be34-f312-45e4-a21e-e4372f0300d3 tempest-GroupSnapshotsV319Test-48001631 None] Create group completed successfully. Aug 05 10:30:42 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 1073741824" returned: 0 in 0.796s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:42 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 Aug 05 10:30:42 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:42 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1" returned: 0 in 0.304s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:30:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369b0c7e-6455-4d34-9521-08c75db89ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3b9f785-69f1-4b79-81c3-325288aedcb1', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc110efa-a504-4263-8908-bd760a77dc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:42 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Volume volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 (a3b9f785-69f1-4b79-81c3-325288aedcb1): created successfully Aug 05 10:30:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc110efa-a504-4263-8908-bd760a77dc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Flow 'volume_create_manager' (d9a29ce7-0783-49e3-9128-5f29df2516eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:42 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-6517b9b5-66b8-4f31-bedd-c1a26913ca3d tempest-VolumesSnapshotTestJSON-182025420 None] Created volume successfully. Aug 05 10:30:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] Creating offline snapshot 10d85e33-3697-4926-8c6d-097e9e3bbfdf of volume a3b9f785-69f1-4b79-81c3-325288aedcb1 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:30:43 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b4c395-cba9-4958-9a9f-f27c0c85c36c]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:43 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 Aug 05 10:30:43 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:44 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:30:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Flow 'volume_create_manager' (61bdfb9e-cce4-42f2-9aa7-6cfebb8f85d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813476d4-7271-45db-bbe4-2720919940dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:44 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1" returned: 0 in 0.506s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813476d4-7271-45db-bbe4-2720919940dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-357879018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=822a9da3-0939-4fc0-9ecb-3ef11ea3b379,host='devstack@QuobyteHD#QuobyteHD',id=9fd48e1e-8edc-4496-86d1-5ecaf7986514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ea70ddb4c047f3b05073dace693259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:44Z,use_quota=True,user_id='de9980a5650f4a1eafce35a0f1e61296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88dd46d-a361-4019-aa13-82d29bd4f7bb),volume_type_id=a88dd46d-a361-4019-aa13-82d29bd4f7bb)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c726b28f-52a0-43fa-9a80-534eba3b2e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:44 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf 1G Aug 05 10:30:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c726b28f-52a0-43fa-9a80-534eba3b2e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:44 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2541e904-0ca3-4397-93f7-c4cd3d9225f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2541e904-0ca3-4397-93f7-c4cd3d9225f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fd48e1e-8edc-4496-86d1-5ecaf7986514', 'volume_name': 'volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d40d6cf-c656-46f8-aaf4-d004ee243349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d40d6cf-c656-46f8-aaf4-d004ee243349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf02671e-c011-4979-b5dc-3d0df351391a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:44 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Volume 9fd48e1e-8edc-4496-86d1-5ecaf7986514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514', 'volume_size': 1} Aug 05 10:30:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:44 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf 1G" returned: 0 in 0.585s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:44 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf Aug 05 10:30:44 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:45 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf" returned: 0 in 0.562s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:45 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf is being set with open permissions: ugo+rw Aug 05 10:30:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:45 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf Aug 05 10:30:45 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:45 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf" returned: 0 in 0.389s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:45 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.info Aug 05 10:30:45 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:46 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.info" returned: 0 in 0.450s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:46 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.info is being set with open permissions: ugo+rw Aug 05 10:30:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:46 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.info Aug 05 10:30:46 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:46 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.info" returned: 0 in 0.597s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.371s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.759s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=822a9da3-0939-4fc0-9ecb-3ef11ea3b379,created_at=2026-08-05T08:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-357879018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=822a9da3-0939-4fc0-9ecb-3ef11ea3b379,host='devstack@QuobyteHD#QuobyteHD',id=9fd48e1e-8edc-4496-86d1-5ecaf7986514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ea70ddb4c047f3b05073dace693259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:44Z,use_quota=True,user_id='de9980a5650f4a1eafce35a0f1e61296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88dd46d-a361-4019-aa13-82d29bd4f7bb),volume_type_id=a88dd46d-a361-4019-aa13-82d29bd4f7bb)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:30:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Creating volume 9fd48e1e-8edc-4496-86d1-5ecaf7986514 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:30:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:30:47 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:30:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:47 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d4748f69-4312-43bd-b28a-395371c0f669 tempest-VolumesSnapshotTestJSON-182025420 None] Create snapshot completed successfully Aug 05 10:30:47 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514 1073741824 Aug 05 10:30:47 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:47 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514 1073741824" returned: 0 in 0.874s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:48 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514 Aug 05 10:30:48 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:48 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514" returned: 0 in 0.676s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:30:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf02671e-c011-4979-b5dc-3d0df351391a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb67864f-092d-4ebb-b7cc-ad9131c43d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:48 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Volume volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514 (9fd48e1e-8edc-4496-86d1-5ecaf7986514): created successfully Aug 05 10:30:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb67864f-092d-4ebb-b7cc-ad9131c43d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Flow 'volume_create_manager' (61bdfb9e-cce4-42f2-9aa7-6cfebb8f85d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:48 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-418624da-a2f6-44be-8414-c4cae4a4deb6 tempest-GroupSnapshotsV319Test-48001631 None] Created volume successfully. Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Flow 'volume_create_manager' (6945f065-9071-4ba0-bd10-e2f18b63143f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a60a81-edb1-4785-be2d-d5a0b02ad264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a60a81-edb1-4785-be2d-d5a0b02ad264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1869901547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ebea94-ad08-4c8f-8b44-8e82a34b12e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1200cd63afa4175a61e9b5613680143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=10d85e33-3697-4926-8c6d-097e9e3bbfdf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:30:49Z,use_quota=True,user_id='ed760878836741cfbbac0f719e81272b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7148105a-d133-4cc1-a97c-6321a7254b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7148105a-d133-4cc1-a97c-6321a7254b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44286ed-ba9a-4699-bd66-fcf36792dc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44286ed-ba9a-4699-bd66-fcf36792dc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '85ebea94-ad08-4c8f-8b44-8e82a34b12e7', 'volume_name': 'volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7', 'volume_size': 1, 'snapshot_id': '10d85e33-3697-4926-8c6d-097e9e3bbfdf'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72feff18-753d-4996-a842-45eab7260a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72feff18-753d-4996-a842-45eab7260a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (befca69b-767f-420f-b671-acdcb98acf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:30:49 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Volume 85ebea94-ad08-4c8f-8b44-8e82a34b12e7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7', 'volume_size': 1, 'snapshot_id': '10d85e33-3697-4926-8c6d-097e9e3bbfdf'} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-quobyte-10d85e33-3697-4926-8c6d-097e9e3bbfdf-85ebea94-ad08-4c8f-8b44-8e82a34b12e7" by "_create_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-10d85e33-3697-4926-8c6d-097e9e3bbfdf-85ebea94-ad08-4c8f-8b44-8e82a34b12e7" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Creating volume 85ebea94-ad08-4c8f-8b44-8e82a34b12e7 from snapshot 10d85e33-3697-4926-8c6d-097e9e3bbfdf {{(pid=88736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-quobyte-85ebea94-ad08-4c8f-8b44-8e82a34b12e7" by "_copy_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-85ebea94-ad08-4c8f-8b44-8e82a34b12e7" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] snapshot: 10d85e33-3697-4926-8c6d-097e9e3bbfdf, volume: 85ebea94-ad08-4c8f-8b44-8e82a34b12e7, {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[463b1b67-15be-4e5f-ae72-65a66e383f92]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:50 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf Aug 05 10:30:50 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:50 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] GroupSnapshot c5541d1f-c4f2-400c-ae0d-a3e4046b2011: creating. Aug 05 10:30:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] Group snapshot c5541d1f-c4f2-400c-ae0d-a3e4046b2011: creating. {{(pid=88736) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 10:30:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:30:50 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf" returned: 0 in 0.769s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3b9f785-69f1-4b79-81c3-325288aedcb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:30:50 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2aaff0-c4a7-409a-a965-a3fc701d5b3c]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:30:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:50 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 Aug 05 10:30:50 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:30:51 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Aug 05 10:30:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1" returned: 0 in 0.699s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:30:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] will copy from snapshot at /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:30:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Creating direct copy from snapshot {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:30:51 devstack cinder-volume[88736]: DEBUG cinder.utils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Path /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7 not found in is_blk_device check {{(pid=88736) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:30:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:30:51 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7 Aug 05 10:30:51 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:00 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=133,cinder:INSERT=33,cinder:UPDATE=140,cinder:DELETE=6 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:31:00 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=128,cinder:INSERT=41,cinder:UPDATE=146,cinder:DELETE=11 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:31:00 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7" returned: 0 in 9.336s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:00 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Image conversion details: src /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1, size 1024.00 MB, duration 9.36 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7 {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:31:00 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Converted 1024.00 MB image at 109.42 MB/s Aug 05 10:31:00 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7 is being set with open permissions: ugo+rw Aug 05 10:31:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:00 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7 Aug 05 10:31:00 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:01 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7" returned: 0 in 0.364s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-85ebea94-ad08-4c8f-8b44-8e82a34b12e7" released by "_copy_volume_from_snapshot" :: held 11.378s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-10d85e33-3697-4926-8c6d-097e9e3bbfdf-85ebea94-ad08-4c8f-8b44-8e82a34b12e7" released by "_create_volume_from_snapshot" :: held 11.525s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.555s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.652s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] Creating offline snapshot 68d116a6-3fa1-4803-9b44-ab031e6bd567 of volume 9fd48e1e-8edc-4496-86d1-5ecaf7986514 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:31:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (befca69b-767f-420f-b671-acdcb98acf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7', 'volume_size': 1, 'snapshot_id': '10d85e33-3697-4926-8c6d-097e9e3bbfdf'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c258b3-ff23-46dd-8285-2e7677a3980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:01 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[194664bd-5747-40d7-bda9-7e362584c648]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:01 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Volume volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7 (85ebea94-ad08-4c8f-8b44-8e82a34b12e7): created successfully Aug 05 10:31:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c258b3-ff23-46dd-8285-2e7677a3980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Flow 'volume_create_manager' (6945f065-9071-4ba0-bd10-e2f18b63143f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:31:01 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-88627b3c-3d36-4550-bdfc-7368c941d048 tempest-VolumesSnapshotTestJSON-182025420 None] Created volume successfully. Aug 05 10:31:01 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514 Aug 05 10:31:01 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-85ebea94-ad08-4c8f-8b44-8e82a34b12e7-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:02 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514" returned: 0 in 0.805s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-85ebea94-ad08-4c8f-8b44-8e82a34b12e7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:02 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567 1G Aug 05 10:31:02 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-quobyte-85ebea94-ad08-4c8f-8b44-8e82a34b12e7" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-85ebea94-ad08-4c8f-8b44-8e82a34b12e7" acquired by "delete_volume" :: waited 0.027s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:02 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89bd637-348a-47b6-9236-f85fd51a9ba0]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:02 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7 Aug 05 10:31:02 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:02 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:02 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567 1G" returned: 0 in 0.683s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7" returned: 0 in 0.549s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:02 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567 Aug 05 10:31:02 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:02 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7 Aug 05 10:31:02 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:03 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-85ebea94-ad08-4c8f-8b44-8e82a34b12e7" returned: 0 in 0.354s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-85ebea94-ad08-4c8f-8b44-8e82a34b12e7" released by "delete_volume" :: held 0.990s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:03 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567" returned: 0 in 0.435s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:03 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:31:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:03 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567 Aug 05 10:31:03 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:03 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] Created reservations ['e80bc1df-1276-4a46-842c-63d1c97a2c23', 'a7635d9f-e60e-49fe-ac6d-05d9c743a344', 'd0e16425-6541-4393-a3ff-720e1dec1ed4', '0785fc7e-27e4-4529-bbc3-8e3c7a1e67d5'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:03 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:31:03 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:03 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567" returned: 0 in 0.395s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:03 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.info Aug 05 10:31:03 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:03 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.326s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:03 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:03 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] Deleted volume successfully. Aug 05 10:31:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5d75b424-7d6a-4bca-9f86-4e01f63ecba6 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-85ebea94-ad08-4c8f-8b44-8e82a34b12e7-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:04 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.info" returned: 0 in 0.381s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:04 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:04 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.info Aug 05 10:31:04 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:04 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.info" returned: 0 in 0.381s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.288s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:04 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a6cc4516-2d4e-4a41-8e91-8a00594fa934 tempest-GroupSnapshotsV319Test-48001631 None] group_snapshot c5541d1f-c4f2-400c-ae0d-a3e4046b2011: created successfully Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-10d85e33-3697-4926-8c6d-097e9e3bbfdf-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Flow 'volume_create_manager' (29181100-931a-4889-a35a-73f900b2a572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df83aafa-f201-4c01-9ae4-1d529b2a6411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df83aafa-f201-4c01-9ae4-1d529b2a6411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1082801073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377df74c-c7e3-4226-a8ae-e6708073abf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04c38f0f475418480b6433d464f03b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:31:05Z,use_quota=True,user_id='6de2c570c7a64c0aaf5c695b9a00d8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c4e0bd-6f18-4243-95e6-2775eaeea375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c4e0bd-6f18-4243-95e6-2775eaeea375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f140bc1-d810-4248-b2b9-2d03e26dff7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f140bc1-d810-4248-b2b9-2d03e26dff7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '377df74c-c7e3-4226-a8ae-e6708073abf2', 'volume_name': 'volume-377df74c-c7e3-4226-a8ae-e6708073abf2', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3073c9d-386c-4a50-84c2-6966c20ada99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3073c9d-386c-4a50-84c2-6966c20ada99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebd1ef1-bc72-482c-a3a5-33c9224dd9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:04 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Volume 377df74c-c7e3-4226-a8ae-e6708073abf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-377df74c-c7e3-4226-a8ae-e6708073abf2', 'volume_size': 1} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1082801073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377df74c-c7e3-4226-a8ae-e6708073abf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04c38f0f475418480b6433d464f03b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:31:05Z,use_quota=True,user_id='6de2c570c7a64c0aaf5c695b9a00d8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Creating volume 377df74c-c7e3-4226-a8ae-e6708073abf2 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:31:04 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-377df74c-c7e3-4226-a8ae-e6708073abf2 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-10d85e33-3697-4926-8c6d-097e9e3bbfdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.134s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-quobyte-a3b9f785-69f1-4b79-81c3-325288aedcb1" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-a3b9f785-69f1-4b79-81c3-325288aedcb1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-quobyte-10d85e33-3697-4926-8c6d-097e9e3bbfdf" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:04 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-377df74c-c7e3-4226-a8ae-e6708073abf2 1073741824 Aug 05 10:31:04 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-10d85e33-3697-4926-8c6d-097e9e3bbfdf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] Deleting offline snapshot 10d85e33-3697-4926-8c6d-097e9e3bbfdf of volume a3b9f785-69f1-4b79-81c3-325288aedcb1 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] snapshot_file for this snap is: volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[322a6653-2402-4481-b8cf-f7916dfd8017]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:05 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf Aug 05 10:31:05 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:05 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf" returned: 0 in 0.603s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3b9f785-69f1-4b79-81c3-325288aedcb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:31:05 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-377df74c-c7e3-4226-a8ae-e6708073abf2 1073741824" returned: 0 in 0.770s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:05 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83eb02a-2a48-4cd4-85a4-393051eadbce]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-377df74c-c7e3-4226-a8ae-e6708073abf2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:05 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-377df74c-c7e3-4226-a8ae-e6708073abf2 Aug 05 10:31:05 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:05 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 Aug 05 10:31:05 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:06 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] group_snapshot c5541d1f-c4f2-400c-ae0d-a3e4046b2011: deleting Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] group_snapshot c5541d1f-c4f2-400c-ae0d-a3e4046b2011: deleting {{(pid=88736) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 10:31:06 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-377df74c-c7e3-4226-a8ae-e6708073abf2" returned: 0 in 0.519s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebd1ef1-bc72-482c-a3a5-33c9224dd9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-377df74c-c7e3-4226-a8ae-e6708073abf2', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5393f3-544f-4033-b81e-4647952ce8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] Acquiring lock "cinder-quobyte-9fd48e1e-8edc-4496-86d1-5ecaf7986514" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:06 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:06 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Volume volume-377df74c-c7e3-4226-a8ae-e6708073abf2 (377df74c-c7e3-4226-a8ae-e6708073abf2): created successfully Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5393f3-544f-4033-b81e-4647952ce8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Flow 'volume_create_manager' (29181100-931a-4889-a35a-73f900b2a572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1" returned: 0 in 0.688s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] Lock "cinder-quobyte-9fd48e1e-8edc-4496-86d1-5ecaf7986514" acquired by "delete_snapshot" :: waited 0.066s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] Acquiring lock "cinder-quobyte-68d116a6-3fa1-4803-9b44-ab031e6bd567" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:06 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a50b88ff-c0b8-4337-88dd-70c3195bae52 tempest-ServerRescueNegativeTestJSON-819602640 None] Created volume successfully. Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] Lock "cinder-quobyte-68d116a6-3fa1-4803-9b44-ab031e6bd567" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] Deleting offline snapshot 68d116a6-3fa1-4803-9b44-ab031e6bd567 of volume 9fd48e1e-8edc-4496-86d1-5ecaf7986514 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:31:06 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf Aug 05 10:31:06 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] snapshot_file for this snap is: volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a78e82-574b-414a-984b-ac0ba385ba85]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:06 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567 Aug 05 10:31:06 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:06 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf" returned: 0 in 0.499s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:06 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf Aug 05 10:31:06 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:06 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567" returned: 0 in 0.570s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:31:07 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[95288f35-98e5-4363-9144-72f2e9b90d3d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:07 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1.10d85e33-3697-4926-8c6d-097e9e3bbfdf" returned: 0 in 0.411s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:07 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514 Aug 05 10:31:07 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-10d85e33-3697-4926-8c6d-097e9e3bbfdf" released by "_delete_snapshot" :: held 2.447s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-a3b9f785-69f1-4b79-81c3-325288aedcb1" released by "delete_snapshot" :: held 2.487s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:07 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] Created reservations ['fd58d374-872b-488f-8dac-e6b2f3e24f70', '36593de0-faf7-4c76-a40c-4fff579d3be6', 'e8ff4fa6-741c-448f-ae04-efbb4e347a86', '1bf458a7-4a75-4eb4-86a7-66053a06951c'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:07 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] Delete snapshot completed successfully. Aug 05 10:31:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cb665874-3250-451e-a99a-36d6f3d65ac0 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-10d85e33-3697-4926-8c6d-097e9e3bbfdf-delete_snapshot" released by "delete_snapshot" :: held 2.754s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:07 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514" returned: 0 in 0.556s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:07 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567 Aug 05 10:31:07 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:08 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567" returned: 0 in 0.463s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:08 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567 Aug 05 10:31:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-a3b9f785-69f1-4b79-81c3-325288aedcb1-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:08 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-a3b9f785-69f1-4b79-81c3-325288aedcb1-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-quobyte-a3b9f785-69f1-4b79-81c3-325288aedcb1" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-a3b9f785-69f1-4b79-81c3-325288aedcb1" acquired by "delete_volume" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:08 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c59aaa-2d7b-4a49-bebd-06bc41277314]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:08 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 Aug 05 10:31:08 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:08 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514.68d116a6-3fa1-4803-9b44-ab031e6bd567" returned: 0 in 0.610s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] Lock "cinder-quobyte-68d116a6-3fa1-4803-9b44-ab031e6bd567" released by "_delete_snapshot" :: held 2.408s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] Lock "cinder-quobyte-9fd48e1e-8edc-4496-86d1-5ecaf7986514" released by "delete_snapshot" :: held 2.464s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:08 devstack cinder-volume[88736]: WARNING cinder.quota [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2023147483 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2023147483, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:31:08 devstack cinder-volume[88736]: WARNING cinder.quota [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2023147483 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2023147483, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:31:08 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1" returned: 0 in 0.620s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:08 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] Created reservations ['0eda94f0-55ae-4b17-9014-ed0a5e614981', 'b6ba83f1-40cf-496b-94ab-8d442774a396', 'd8ad8269-4a28-430a-a73f-de056729a3c1', '697c773c-4926-4504-ac9b-e13745e43932'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:09 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1 Aug 05 10:31:09 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:09 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8dc79ad7-deb4-4f7c-96c9-ea55ff83c62a tempest-GroupSnapshotsV319Test-48001631 None] group_snapshot c5541d1f-c4f2-400c-ae0d-a3e4046b2011: deleted successfully Aug 05 10:31:09 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a3b9f785-69f1-4b79-81c3-325288aedcb1" returned: 0 in 0.422s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-a3b9f785-69f1-4b79-81c3-325288aedcb1" released by "delete_volume" :: held 1.116s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:09 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] Created reservations ['c133b2bf-d2fe-4a70-b1e1-5fd5bd789d22', '37ede0d4-1b4f-46be-a568-89bd5443cfb6', 'ea433e15-18a3-48fd-b82f-4afe7d1aa26c', '45cf6991-3899-48db-ba67-a18c9cbc9d00'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:09 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:31:09 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:10 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.447s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:10 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:10 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] Deleted volume successfully. Aug 05 10:31:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b22b6e0a-35f4-4a32-a9c0-7f44fbab95fc tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-a3b9f785-69f1-4b79-81c3-325288aedcb1-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] Acquiring lock "cinder-quobyte-9fd48e1e-8edc-4496-86d1-5ecaf7986514" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] Lock "cinder-quobyte-9fd48e1e-8edc-4496-86d1-5ecaf7986514" acquired by "delete_volume" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:10 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d404f5-d257-4b3c-b46a-9ab1c35994a3]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:10 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514 Aug 05 10:31:10 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-e3a6d6f4-72d7-4629-a681-70626c1029d9-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-e3a6d6f4-72d7-4629-a681-70626c1029d9-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "cinder-quobyte-e3a6d6f4-72d7-4629-a681-70626c1029d9" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-e3a6d6f4-72d7-4629-a681-70626c1029d9" acquired by "delete_volume" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:10 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[587f8791-4407-4657-bc9c-cd81270874ca]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:11 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514" returned: 0 in 0.720s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:11 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9 Aug 05 10:31:11 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:11 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514 Aug 05 10:31:11 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:11 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9fd48e1e-8edc-4496-86d1-5ecaf7986514" returned: 0 in 0.395s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] Lock "cinder-quobyte-9fd48e1e-8edc-4496-86d1-5ecaf7986514" released by "delete_volume" :: held 1.240s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:11 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9" returned: 0 in 0.604s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:11 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9 Aug 05 10:31:11 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:11 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] Created reservations ['175151cb-8e42-4ea9-8545-8fa776641033'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:11 devstack cinder-volume[88736]: WARNING cinder.quota [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2023147483 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2023147483, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:31:11 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] Created reservations ['6cfd6ac0-737c-45e9-ba81-ae5b441a1fbd', '3b048385-3e60-4d0f-b5f7-f30dd60f2214', 'b41e9629-3b63-490b-8f5f-a974eb4a2e48', '57b0ce3e-758d-493c-b353-7b5545c7ca4b'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:12 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:31:12 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:12 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e3a6d6f4-72d7-4629-a681-70626c1029d9" returned: 0 in 0.610s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-quobyte-e3a6d6f4-72d7-4629-a681-70626c1029d9" released by "delete_volume" :: held 1.314s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] Created reservations ['f12ce795-6dbd-40df-8907-67d0b4786818', '29aeba2d-63b0-4664-a71a-60d0b26ab5a2', 'df0588d8-f178-4f21-932e-1463c0653239', '14fdf610-141f-41b3-bc67-080ce034108c'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:12 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:31:12 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:12 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.450s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:12 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-3c949704-0243-42ed-bc2f-079b298b79c2 tempest-GroupSnapshotsV319Test-48001631 None] Delete group completed successfully. Aug 05 10:31:12 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.405s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:12 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] Deleted volume successfully. Aug 05 10:31:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1de0005f-6cf9-4358-80f9-3fc5371e3e34 tempest-VolumesSnapshotTestJSON-182025420 None] Lock "cinder-e3a6d6f4-72d7-4629-a681-70626c1029d9-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:31:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:13 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:31:13 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:14 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.628s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:31:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:31:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Flow 'volume_create_manager' (1fd1f239-4b59-4c7b-ab84-2d4d9167c025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f31002-e788-4d7f-bdc4-26000004a39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f31002-e788-4d7f-bdc4-26000004a39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1978695995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44c5769-ee6b-4b4d-a871-8dc9f66ded0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9c40b728734cdc8518bf8326145ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:31:17Z,use_quota=True,user_id='4fac7cbee7ab4a6f9d7576ebba7f220d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03851ae-a28e-48c3-adc2-11ee78ddc775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03851ae-a28e-48c3-adc2-11ee78ddc775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6a96de-237f-49a7-ab95-4ac2fc38c3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6a96de-237f-49a7-ab95-4ac2fc38c3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b44c5769-ee6b-4b4d-a871-8dc9f66ded0a', 'volume_name': 'volume-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840a25ea-8585-4b4c-829b-a9e3326e77dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840a25ea-8585-4b4c-829b-a9e3326e77dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c32224d-e765-4214-b111-3f68901a54b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:17 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Volume b44c5769-ee6b-4b4d-a871-8dc9f66ded0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a', 'volume_size': 1} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1978695995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44c5769-ee6b-4b4d-a871-8dc9f66ded0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9c40b728734cdc8518bf8326145ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:31:17Z,use_quota=True,user_id='4fac7cbee7ab4a6f9d7576ebba7f220d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Creating volume b44c5769-ee6b-4b4d-a871-8dc9f66ded0a {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:31:17 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:17 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a 1073741824 Aug 05 10:31:17 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:17 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a 1073741824" returned: 0 in 0.610s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:17 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a Aug 05 10:31:17 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:18 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a" returned: 0 in 0.315s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:31:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c32224d-e765-4214-b111-3f68901a54b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fce6562-b2a4-4595-9d3f-517c7925429c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:18 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Volume volume-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a (b44c5769-ee6b-4b4d-a871-8dc9f66ded0a): created successfully Aug 05 10:31:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fce6562-b2a4-4595-9d3f-517c7925429c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Flow 'volume_create_manager' (1fd1f239-4b59-4c7b-ab84-2d4d9167c025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:31:18 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a0f186ad-37ce-4204-8f1d-dafde5c274ab tempest-VolumesTransfersTest-153177629 None] Created volume successfully. Aug 05 10:31:20 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-5da15269-c252-4c9a-9253-b1f9d5151195 tempest-VolumesTransfersTest-1235456680 None] Transfer volume completed successfully. Aug 05 10:31:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] Acquiring lock "cinder-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] Lock "cinder-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] Acquiring lock "cinder-quobyte-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] Lock "cinder-quobyte-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a" acquired by "delete_volume" :: waited 0.051s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] Acquiring lock "cinder-377df74c-c7e3-4226-a8ae-e6708073abf2-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:21 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b621ec39-c00d-476b-ac0c-b2adb0a6c82c]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] Lock "cinder-377df74c-c7e3-4226-a8ae-e6708073abf2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] Acquiring lock "cinder-quobyte-377df74c-c7e3-4226-a8ae-e6708073abf2" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] Lock "cinder-quobyte-377df74c-c7e3-4226-a8ae-e6708073abf2" acquired by "delete_volume" :: waited 0.034s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:21 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a Aug 05 10:31:21 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:21 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f64403-5549-48c7-988e-2474d1bad181]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-377df74c-c7e3-4226-a8ae-e6708073abf2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:22 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-377df74c-c7e3-4226-a8ae-e6708073abf2 Aug 05 10:31:22 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:22 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a" returned: 0 in 0.625s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:22 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a Aug 05 10:31:22 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:22 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-377df74c-c7e3-4226-a8ae-e6708073abf2" returned: 0 in 0.664s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-377df74c-c7e3-4226-a8ae-e6708073abf2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:22 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-377df74c-c7e3-4226-a8ae-e6708073abf2 Aug 05 10:31:22 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:22 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a" returned: 0 in 0.445s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] Lock "cinder-quobyte-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a" released by "delete_volume" :: held 1.165s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:22 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] Created reservations ['b4c494d6-f1ce-41d7-999f-bec7fd74ff5d', 'd11e3b77-d794-4261-80a1-99c3c70ee7c3', '12e58015-b1e8-4d1a-adcd-a85137f2a055', '0b49e988-5f21-4b75-a0e4-7ff5c13784b0'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:23 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:31:23 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:23 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-377df74c-c7e3-4226-a8ae-e6708073abf2" returned: 0 in 0.645s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] Lock "cinder-quobyte-377df74c-c7e3-4226-a8ae-e6708073abf2" released by "delete_volume" :: held 1.407s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] Created reservations ['3cef2cd0-46db-4aa1-aa3e-c02421f77915', '0e69b84d-6b01-471d-8095-14aadffc6726', '4ade9f75-a739-446f-874b-56f043c09d04', 'cc1ac3ed-e7ff-4d1a-952c-88e42552c0a5'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:23 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.544s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:23 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] Deleted volume successfully. Aug 05 10:31:23 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:31:23 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:23 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8e66e090-9b97-428e-bee5-87e4118df766 tempest-VolumesTransfersTest-1292513495 None] Lock "cinder-b44c5769-ee6b-4b4d-a871-8dc9f66ded0a-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:24 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.719s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:24 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:24 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] Deleted volume successfully. Aug 05 10:31:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99d5b6fb-e921-48b0-ba74-01656e717c10 tempest-ServerRescueNegativeTestJSON-819602640 None] Lock "cinder-377df74c-c7e3-4226-a8ae-e6708073abf2-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Flow 'volume_create_manager' (ad4a19ab-3552-469a-b06a-2781566a2570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e1c077-2de4-46f0-b124-d0a30fb12adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e1c077-2de4-46f0-b124-d0a30fb12adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1122178814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42517dd2-f9b8-433a-8f36-3907473b4c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9c40b728734cdc8518bf8326145ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:31:25Z,use_quota=True,user_id='4fac7cbee7ab4a6f9d7576ebba7f220d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afcf933e-b5ec-4feb-91f3-e3cfb3ce2296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afcf933e-b5ec-4feb-91f3-e3cfb3ce2296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c23f38-4aae-42ac-8427-0f2693c165fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c23f38-4aae-42ac-8427-0f2693c165fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42517dd2-f9b8-433a-8f36-3907473b4c24', 'volume_name': 'volume-42517dd2-f9b8-433a-8f36-3907473b4c24', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a54c21-a127-4bf5-b280-e81c8f402c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a54c21-a127-4bf5-b280-e81c8f402c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff3f856-6ac0-45ad-ac02-0476ef4fe7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:25 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Volume 42517dd2-f9b8-433a-8f36-3907473b4c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42517dd2-f9b8-433a-8f36-3907473b4c24', 'volume_size': 1} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1122178814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42517dd2-f9b8-433a-8f36-3907473b4c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9c40b728734cdc8518bf8326145ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:31:25Z,use_quota=True,user_id='4fac7cbee7ab4a6f9d7576ebba7f220d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Creating volume 42517dd2-f9b8-433a-8f36-3907473b4c24 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:31:25 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:31:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-42517dd2-f9b8-433a-8f36-3907473b4c24 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:25 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-42517dd2-f9b8-433a-8f36-3907473b4c24 1073741824 Aug 05 10:31:25 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:26 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-42517dd2-f9b8-433a-8f36-3907473b4c24 1073741824" returned: 0 in 1.097s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-42517dd2-f9b8-433a-8f36-3907473b4c24 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:26 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-42517dd2-f9b8-433a-8f36-3907473b4c24 Aug 05 10:31:26 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:26 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-42517dd2-f9b8-433a-8f36-3907473b4c24" returned: 0 in 0.346s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:26 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:31:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:26 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff3f856-6ac0-45ad-ac02-0476ef4fe7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42517dd2-f9b8-433a-8f36-3907473b4c24', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:26 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521238cf-9bcc-4934-ab9d-968720baf92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:26 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Volume volume-42517dd2-f9b8-433a-8f36-3907473b4c24 (42517dd2-f9b8-433a-8f36-3907473b4c24): created successfully Aug 05 10:31:26 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521238cf-9bcc-4934-ab9d-968720baf92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:26 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Flow 'volume_create_manager' (ad4a19ab-3552-469a-b06a-2781566a2570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:31:27 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-0ba5a5d8-3dc7-4618-b447-c2ea0f6ee649 tempest-VolumesTransfersTest-153177629 None] Created volume successfully. Aug 05 10:31:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] Acquiring lock "cinder-42517dd2-f9b8-433a-8f36-3907473b4c24-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] Lock "cinder-42517dd2-f9b8-433a-8f36-3907473b4c24-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] Acquiring lock "cinder-quobyte-42517dd2-f9b8-433a-8f36-3907473b4c24" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:31:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] Lock "cinder-quobyte-42517dd2-f9b8-433a-8f36-3907473b4c24" acquired by "delete_volume" :: waited 0.032s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:31:28 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d3b7a1-a715-4685-af8f-62b17e86beb4]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:31:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-42517dd2-f9b8-433a-8f36-3907473b4c24 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:28 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-42517dd2-f9b8-433a-8f36-3907473b4c24 Aug 05 10:31:28 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:28 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-42517dd2-f9b8-433a-8f36-3907473b4c24" returned: 0 in 0.546s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-42517dd2-f9b8-433a-8f36-3907473b4c24 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:28 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-42517dd2-f9b8-433a-8f36-3907473b4c24 Aug 05 10:31:28 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:29 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-42517dd2-f9b8-433a-8f36-3907473b4c24" returned: 0 in 0.497s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] Lock "cinder-quobyte-42517dd2-f9b8-433a-8f36-3907473b4c24" released by "delete_volume" :: held 1.129s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:29 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] Created reservations ['28b848bb-32d7-4b9a-bb9d-925c7297b8c9', '673e7efe-de18-4e4d-8154-79aef9489589', 'a1bf791a-c532-42f1-9034-b6acb061c9f3', '53e12b3e-fb87-4dbc-9f17-a17014756c2b'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:31:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:29 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:31:29 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:29 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.263s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:29 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:31:29 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] Deleted volume successfully. Aug 05 10:31:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-155e485d-fd2f-4c88-b201-49d8095b8a0e tempest-VolumesTransfersTest-1292513495 None] Lock "cinder-42517dd2-f9b8-433a-8f36-3907473b4c24-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:31:39 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=62,cinder:UPDATE=90,cinder:DELETE=5,cinder:INSERT=24 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:31:39 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=64,cinder:UPDATE=78,cinder:INSERT=18,cinder:DELETE=5 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Flow 'volume_create_manager' (7cbb3cce-42c9-495a-8c8f-f8795831af41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a874401a-b5fb-4a45-b243-8f15a048001c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a874401a-b5fb-4a45-b243-8f15a048001c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1183937859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8d60e3-6937-4eb0-9d73-8f55dfa640f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbd3d62914443b8b26bf0eade042e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:31:43Z,use_quota=True,user_id='37676f8e97c143da8ab307a92912e6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c875e303-338b-46bd-a3c0-7d99acb1babf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c875e303-338b-46bd-a3c0-7d99acb1babf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ca5622-1988-43d7-a34c-e3cfe1dc44ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ca5622-1988-43d7-a34c-e3cfe1dc44ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a8d60e3-6937-4eb0-9d73-8f55dfa640f0', 'volume_name': 'volume-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f15da7-460c-4508-a5e1-0d24fb69e1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f15da7-460c-4508-a5e1-0d24fb69e1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792c3a3d-fbc4-4132-97f3-bdb0a95888b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:43 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Volume 4a8d60e3-6937-4eb0-9d73-8f55dfa640f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0', 'volume_size': 1} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1183937859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8d60e3-6937-4eb0-9d73-8f55dfa640f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbd3d62914443b8b26bf0eade042e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:31:43Z,use_quota=True,user_id='37676f8e97c143da8ab307a92912e6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Creating volume 4a8d60e3-6937-4eb0-9d73-8f55dfa640f0 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:31:43 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:43 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0 1073741824 Aug 05 10:31:43 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:43 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0 1073741824" returned: 0 in 0.619s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:31:43 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0 Aug 05 10:31:43 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:31:44 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Aug 05 10:31:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0" returned: 0 in 0.329s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:31:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:31:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:31:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792c3a3d-fbc4-4132-97f3-bdb0a95888b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d65c5c-a2a3-46ed-bee1-74309844a515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:31:44 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Volume volume-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0 (4a8d60e3-6937-4eb0-9d73-8f55dfa640f0): created successfully Aug 05 10:31:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d65c5c-a2a3-46ed-bee1-74309844a515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:31:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Flow 'volume_create_manager' (7cbb3cce-42c9-495a-8c8f-f8795831af41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:31:44 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e0366253-d15f-45e9-9572-5ed2558a8fa9 tempest-VolumesNegativeTest-983893914 None] Created volume successfully. Aug 05 10:31:54 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:31:54 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:32:06 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=1 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:32:06 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:UPDATE=1 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:32:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:32:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.096s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:14 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:32:14 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:14 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.722s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:32:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:32:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Flow 'volume_create_manager' (f59d8b7d-743b-47b9-945b-d0febb8d7788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e8ac49-99da-4a8a-8d00-4ccec4ebf756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e8ac49-99da-4a8a-8d00-4ccec4ebf756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1607958591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9411b60d-f553-4f41-be29-b3360c7377b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb72f9158ff84ad087d6a593930cc73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:21Z,use_quota=True,user_id='8ffb0b9657744108873d97759e0c73c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8dd724-2ef1-436a-ada0-4e5131cd538c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8dd724-2ef1-436a-ada0-4e5131cd538c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ffb11d-1d1a-4521-a48c-917992dab7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ffb11d-1d1a-4521-a48c-917992dab7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9411b60d-f553-4f41-be29-b3360c7377b7', 'volume_name': 'volume-9411b60d-f553-4f41-be29-b3360c7377b7', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9070595-c133-491d-8540-bd79adfa6950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9070595-c133-491d-8540-bd79adfa6950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d52c21-1ab7-427c-84a7-22f452139523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:21 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Volume 9411b60d-f553-4f41-be29-b3360c7377b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9411b60d-f553-4f41-be29-b3360c7377b7', 'volume_size': 1} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1607958591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9411b60d-f553-4f41-be29-b3360c7377b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb72f9158ff84ad087d6a593930cc73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:21Z,use_quota=True,user_id='8ffb0b9657744108873d97759e0c73c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Creating volume 9411b60d-f553-4f41-be29-b3360c7377b7 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:21 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:32:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9411b60d-f553-4f41-be29-b3360c7377b7 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:21 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9411b60d-f553-4f41-be29-b3360c7377b7 1073741824 Aug 05 10:32:21 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:22 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9411b60d-f553-4f41-be29-b3360c7377b7 1073741824" returned: 0 in 1.237s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9411b60d-f553-4f41-be29-b3360c7377b7 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:22 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9411b60d-f553-4f41-be29-b3360c7377b7 Aug 05 10:32:22 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:23 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9411b60d-f553-4f41-be29-b3360c7377b7" returned: 0 in 0.746s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.131s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d52c21-1ab7-427c-84a7-22f452139523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9411b60d-f553-4f41-be29-b3360c7377b7', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11412f9e-5aa9-43ed-a6fb-6b2fa00ccb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:23 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Volume volume-9411b60d-f553-4f41-be29-b3360c7377b7 (9411b60d-f553-4f41-be29-b3360c7377b7): created successfully Aug 05 10:32:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11412f9e-5aa9-43ed-a6fb-6b2fa00ccb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Flow 'volume_create_manager' (f59d8b7d-743b-47b9-945b-d0febb8d7788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:23 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8d564bd4-61ae-4aff-8c9a-08ed196aaae9 tempest-TestMinimumBasicScenario-1680065990 None] Created volume successfully. Aug 05 10:32:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-5243e3ea-6170-4189-87a2-304c49ec2ec5 req-dc9d6b24-90fb-414e-bd87-f17d6ca36639 tempest-TestMinimumBasicScenario-1680065990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-5243e3ea-6170-4189-87a2-304c49ec2ec5 req-dc9d6b24-90fb-414e-bd87-f17d6ca36639 tempest-TestMinimumBasicScenario-1680065990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-5243e3ea-6170-4189-87a2-304c49ec2ec5 req-dc9d6b24-90fb-414e-bd87-f17d6ca36639 tempest-TestMinimumBasicScenario-1680065990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-5243e3ea-6170-4189-87a2-304c49ec2ec5 req-dc9d6b24-90fb-414e-bd87-f17d6ca36639 tempest-TestMinimumBasicScenario-1680065990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-9411b60d-f553-4f41-be29-b3360c7377b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b2b0734-b1ac-4ea8-9a8c-b3225625f940', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:32:28 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-5243e3ea-6170-4189-87a2-304c49ec2ec5 req-dc9d6b24-90fb-414e-bd87-f17d6ca36639 tempest-TestMinimumBasicScenario-1680065990 None] attachment_update completed successfully. Aug 05 10:32:35 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] Acquiring lock "cinder-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:35 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] Lock "cinder-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:35 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] Acquiring lock "cinder-quobyte-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:35 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] Lock "cinder-quobyte-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0" acquired by "delete_volume" :: waited 0.028s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:35 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a179d3d-4d26-4380-ba28-894bb81ed908]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:35 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0 Aug 05 10:32:35 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:36 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0" returned: 0 in 0.579s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:36 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0 Aug 05 10:32:36 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:36 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0" returned: 0 in 0.492s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] Lock "cinder-quobyte-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0" released by "delete_volume" :: held 1.141s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:36 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] Created reservations ['3afeec93-9816-41db-91b8-12ae70a452fb', 'ae3731af-1230-4f2e-8198-0e5770fed4f0', 'e9e003c6-f7a8-4853-ab1d-cf298e34f4b2', '19ff9c1a-5dd2-4325-a969-f9b050b0bf31'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:36 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:32:36 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:37 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.427s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:37 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:37 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] Deleted volume successfully. Aug 05 10:32:37 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c3b7a5b9-5806-4d50-b9c2-4ac4801403ed tempest-VolumesNegativeTest-983893914 None] Lock "cinder-4a8d60e3-6937-4eb0-9d73-8f55dfa640f0-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Flow 'volume_create_manager' (d97cf1db-8255-4be2-a28a-6f4cb0fe6171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa5ea54-e130-497d-8a94-92a895141782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa5ea54-e130-497d-8a94-92a895141782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1381706820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81d1d801aed246c89592b5975e62979c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:47Z,use_quota=True,user_id='d3f954f970fe438c88b416393f961988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5eaee58-d926-401b-a6fa-92de584852a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5eaee58-d926-401b-a6fa-92de584852a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a70703fc-0998-4c5b-a8a0-84e8bd1cb674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a70703fc-0998-4c5b-a8a0-84e8bd1cb674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa', 'volume_name': 'volume-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a65d40f-ee3f-425c-9f38-5f162722cb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a65d40f-ee3f-425c-9f38-5f162722cb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7481da29-af7d-4592-82b0-e9d64e16027d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:46 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Volume b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa', 'volume_size': 1} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1381706820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81d1d801aed246c89592b5975e62979c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:47Z,use_quota=True,user_id='d3f954f970fe438c88b416393f961988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Creating volume b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:46 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:32:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:46 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa 1073741824 Aug 05 10:32:46 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:47 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa 1073741824" returned: 0 in 0.877s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:47 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa Aug 05 10:32:47 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:48 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa" returned: 0 in 0.430s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7481da29-af7d-4592-82b0-e9d64e16027d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64aab576-7d35-482f-8bb8-501d73acfdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:48 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Volume volume-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa (b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa): created successfully Aug 05 10:32:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64aab576-7d35-482f-8bb8-501d73acfdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Flow 'volume_create_manager' (d97cf1db-8255-4be2-a28a-6f4cb0fe6171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:48 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d77a515e-947e-460d-9e4a-2def55a9a8ab tempest-ServersNegativeTestJSON-18059442 None] Created volume successfully. Aug 05 10:32:48 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Flow 'volume_create_manager' (e65fb63d-4159-4c8e-b319-c2f0777c03bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684d8496-e381-45d4-8393-18b0e3eb7a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684d8496-e381-45d4-8393-18b0e3eb7a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1619507627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e291cd0-07ad-4efc-a491-d319e306419d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee651a396e56400b8e33baef9a703420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:49Z,use_quota=True,user_id='d5c139de9fc5467e88b3ca973fb50fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3769b06-4eea-4a6c-b28c-0ce7a94917f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3769b06-4eea-4a6c-b28c-0ce7a94917f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba2f93d-f1bc-433e-bc9d-7b1462ae1c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba2f93d-f1bc-433e-bc9d-7b1462ae1c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e291cd0-07ad-4efc-a491-d319e306419d', 'volume_name': 'volume-4e291cd0-07ad-4efc-a491-d319e306419d', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47de9da-e6cd-476f-aff5-357fc792b922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47de9da-e6cd-476f-aff5-357fc792b922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd8f784-24c6-4a66-9d3a-29e0580c3bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:49 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Volume 4e291cd0-07ad-4efc-a491-d319e306419d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e291cd0-07ad-4efc-a491-d319e306419d', 'volume_size': 1} Aug 05 10:32:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1619507627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e291cd0-07ad-4efc-a491-d319e306419d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee651a396e56400b8e33baef9a703420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:49Z,use_quota=True,user_id='d5c139de9fc5467e88b3ca973fb50fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Creating volume 4e291cd0-07ad-4efc-a491-d319e306419d {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:49 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:32:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4e291cd0-07ad-4efc-a491-d319e306419d 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:49 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4e291cd0-07ad-4efc-a491-d319e306419d 1073741824 Aug 05 10:32:49 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:49 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4e291cd0-07ad-4efc-a491-d319e306419d 1073741824" returned: 0 in 0.777s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4e291cd0-07ad-4efc-a491-d319e306419d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:49 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4e291cd0-07ad-4efc-a491-d319e306419d Aug 05 10:32:49 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Flow 'volume_create_manager' (a6bfb60a-2331-4392-8735-165d442a375c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0704040c-0b34-4779-a810-8bf66e86f0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0704040c-0b34-4779-a810-8bf66e86f0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a226ca3e-add5-46b8-9e26-b4ecfb10e859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef95fae4fb54f58ad0eb5e5087b2a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:50Z,use_quota=True,user_id='0709f331d15c4e0ca00444de181053ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39ef400f-6fcb-4cf2-a567-8e4a90b19511),volume_type_id=39ef400f-6fcb-4cf2-a567-8e4a90b19511)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f75228-e8a8-4af5-ab78-6a570a341681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f75228-e8a8-4af5-ab78-6a570a341681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e091f019-9c3c-47a3-976d-74934a02b564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.image.glance [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Creating Keystone auth plugin from conf {{(pid=88736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:32:50 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4e291cd0-07ad-4efc-a491-d319e306419d" returned: 0 in 0.457s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd8f784-24c6-4a66-9d3a-29e0580c3bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e291cd0-07ad-4efc-a491-d319e306419d', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d535726f-9e68-4995-88e7-c90cda6f9775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:50 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Volume volume-4e291cd0-07ad-4efc-a491-d319e306419d (4e291cd0-07ad-4efc-a491-d319e306419d): created successfully Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d535726f-9e68-4995-88e7-c90cda6f9775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Flow 'volume_create_manager' (e65fb63d-4159-4c8e-b319-c2f0777c03bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:50 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d3cf3f28-ff2f-458b-9155-4e29943ac302 tempest-VolumesActionsTest-162847049 None] Created volume successfully. Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e091f019-9c3c-47a3-976d-74934a02b564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a226ca3e-add5-46b8-9e26-b4ecfb10e859', 'volume_name': 'volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859', 'volume_size': 1, 'image_id': 'a32e5e8b-ea24-4cd1-aa95-89cc85691d03', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a32e5e8b-ea24-4cd1-aa95-89cc85691d03', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7aa89a9756d11b1e959982b5171de636', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ef95fae4fb54f58ad0eb5e5087b2a62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '217da43fc52d60ffcccb61c82733cd8724e5d49957de21e61b58c2dc7784cc1af94cbd921eb55787b34c33bedd040a7e986ffa546129b584210df6e8e146f1ea', 'id': 'a32e5e8b-ea24-4cd1-aa95-89cc85691d03', 'created_at': datetime.datetime(2026, 8, 5, 8, 32, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 32, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a32e5e8b-ea24-4cd1-aa95-89cc85691d03/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a922c31-911b-469c-809e-f0594c3c48b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a922c31-911b-469c-809e-f0594c3c48b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07e96ac-f5fb-4bfa-a2ba-0b47cffcd3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:50 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Volume a226ca3e-add5-46b8-9e26-b4ecfb10e859: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859', 'volume_size': 1, 'image_id': 'a32e5e8b-ea24-4cd1-aa95-89cc85691d03', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a32e5e8b-ea24-4cd1-aa95-89cc85691d03', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7aa89a9756d11b1e959982b5171de636', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ef95fae4fb54f58ad0eb5e5087b2a62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '217da43fc52d60ffcccb61c82733cd8724e5d49957de21e61b58c2dc7784cc1af94cbd921eb55787b34c33bedd040a7e986ffa546129b584210df6e8e146f1ea', 'id': 'a32e5e8b-ea24-4cd1-aa95-89cc85691d03', 'created_at': datetime.datetime(2026, 8, 5, 8, 32, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 32, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a32e5e8b-ea24-4cd1-aa95-89cc85691d03/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Trying to clone a226ca3e-add5-46b8-9e26-b4ecfb10e859 from image a32e5e8b-ea24-4cd1-aa95-89cc85691d03 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a32e5e8b-ea24-4cd1-aa95-89cc85691d03', 'metadata': {}}]). {{(pid=88736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Flow 'volume_create_manager' (b945880c-35ad-44ac-98f7-25b9b31237ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b937928a-b479-42f4-9da9-6ad0e6e87fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ba45549c-e4eb-4b2d-a56f-a582aa901b1b tempest-VolumesActionsTest-162847049 None] Acquiring lock "cinder-4e291cd0-07ad-4efc-a491-d319e306419d" by "attach_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b937928a-b479-42f4-9da9-6ad0e6e87fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2094928044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f92d8a6-ff78-4f02-a216-acc445f7f561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81d1d801aed246c89592b5975e62979c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:51Z,use_quota=True,user_id='d3f954f970fe438c88b416393f961988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a38151d-1435-4631-bae7-35bf5637f47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a38151d-1435-4631-bae7-35bf5637f47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e0eab9-da19-44cd-85fa-8ed7be900826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e0eab9-da19-44cd-85fa-8ed7be900826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f92d8a6-ff78-4f02-a216-acc445f7f561', 'volume_name': 'volume-8f92d8a6-ff78-4f02-a216-acc445f7f561', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337e4f9b-f0bc-4dc3-a869-12baa7818bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337e4f9b-f0bc-4dc3-a869-12baa7818bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159312bd-553e-409a-9e8f-1c749df8b61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:50 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Volume 8f92d8a6-ff78-4f02-a216-acc445f7f561: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f92d8a6-ff78-4f02-a216-acc445f7f561', 'volume_size': 1} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2094928044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f92d8a6-ff78-4f02-a216-acc445f7f561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81d1d801aed246c89592b5975e62979c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:51Z,use_quota=True,user_id='d3f954f970fe438c88b416393f961988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Creating volume 8f92d8a6-ff78-4f02-a216-acc445f7f561 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:50 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8f92d8a6-ff78-4f02-a216-acc445f7f561 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:32:50 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Image download 0.00 MB at 0.00 MB/s Aug 05 10:32:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ba45549c-e4eb-4b2d-a56f-a582aa901b1b tempest-VolumesActionsTest-162847049 None] Lock "cinder-4e291cd0-07ad-4efc-a491-d319e306419d" acquired by "attach_volume" :: waited 0.095s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:50 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8f92d8a6-ff78-4f02-a216-acc445f7f561 1073741824 Aug 05 10:32:50 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:51 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d207756-5c07-4525-9548-d43d56564b2e]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:51 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ba45549c-e4eb-4b2d-a56f-a582aa901b1b tempest-VolumesActionsTest-162847049 None] Attaching volume 4e291cd0-07ad-4efc-a491-d319e306419d to instance ebd821bc-5df1-449e-bd15-edc68ed5eadb at mountpoint /dev/vdb on host None. Aug 05 10:32:51 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ba45549c-e4eb-4b2d-a56f-a582aa901b1b tempest-VolumesActionsTest-162847049 None] Attach volume completed successfully. Aug 05 10:32:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ba45549c-e4eb-4b2d-a56f-a582aa901b1b tempest-VolumesActionsTest-162847049 None] Lock "cinder-4e291cd0-07ad-4efc-a491-d319e306419d" released by "attach_volume" :: held 0.214s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:51 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD Aug 05 10:32:51 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:51 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:51 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8f92d8a6-ff78-4f02-a216-acc445f7f561 1073741824" returned: 0 in 0.634s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8f92d8a6-ff78-4f02-a216-acc445f7f561 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:51 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8f92d8a6-ff78-4f02-a216-acc445f7f561 Aug 05 10:32:51 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:51 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD Aug 05 10:32:51 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:52 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8f92d8a6-ff78-4f02-a216-acc445f7f561" returned: 0 in 0.430s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159312bd-553e-409a-9e8f-1c749df8b61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f92d8a6-ff78-4f02-a216-acc445f7f561', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b14d470-bc0c-40f0-8a3a-4fa6eaa7a489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:32:52 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Volume volume-8f92d8a6-ff78-4f02-a216-acc445f7f561 (8f92d8a6-ff78-4f02-a216-acc445f7f561): created successfully Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b14d470-bc0c-40f0-8a3a-4fa6eaa7a489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Flow 'volume_create_manager' (b945880c-35ad-44ac-98f7-25b9b31237ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:32:52 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-623e63b0-5601-4f20-aa73-31abfd4f9550 tempest-ServersNegativeTestJSON-18059442 None] Created volume successfully. Aug 05 10:32:52 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD" returned: 1 in 0.652s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Temporary image a32e5e8b-ea24-4cd1-aa95-89cc85691d03 is fetched for user 0709f331d15c4e0ca00444de181053ad. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:32:52 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e28cf6a7-8394-455f-b846-966aca894f2b tempest-VolumesActionsTest-2096564748 None] Terminate volume connection completed successfully. Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e28cf6a7-8394-455f-b846-966aca894f2b tempest-VolumesActionsTest-2096564748 None] Acquiring lock "cinder-4e291cd0-07ad-4efc-a491-d319e306419d-detach_volume" by "detach_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c3effc-2f1d-4756-b205-8d406133f89c]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e28cf6a7-8394-455f-b846-966aca894f2b tempest-VolumesActionsTest-2096564748 None] Lock "cinder-4e291cd0-07ad-4efc-a491-d319e306419d-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:52 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e28cf6a7-8394-455f-b846-966aca894f2b tempest-VolumesActionsTest-2096564748 None] Detaching volume 4e291cd0-07ad-4efc-a491-d319e306419d from instance ebd821bc-5df1-449e-bd15-edc68ed5eadb. Aug 05 10:32:52 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e28cf6a7-8394-455f-b846-966aca894f2b tempest-VolumesActionsTest-2096564748 None] Detach volume completed successfully. Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e28cf6a7-8394-455f-b846-966aca894f2b tempest-VolumesActionsTest-2096564748 None] Lock "cinder-4e291cd0-07ad-4efc-a491-d319e306419d-detach_volume" released by "detach_volume" :: held 0.090s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:52 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD Aug 05 10:32:52 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d00e80ba-983b-452b-821d-75978bf77489 tempest-VolumesActionsTest-162847049 None] Acquiring lock "cinder-4e291cd0-07ad-4efc-a491-d319e306419d-detach_volume" by "detach_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d00e80ba-983b-452b-821d-75978bf77489 tempest-VolumesActionsTest-162847049 None] Lock "cinder-4e291cd0-07ad-4efc-a491-d319e306419d-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:52 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d00e80ba-983b-452b-821d-75978bf77489 tempest-VolumesActionsTest-162847049 None] Volume detach called, but volume not attached. Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d00e80ba-983b-452b-821d-75978bf77489 tempest-VolumesActionsTest-162847049 None] Lock "cinder-4e291cd0-07ad-4efc-a491-d319e306419d-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:52 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD" returned: 0 in 0.609s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] Acquiring lock "cinder-4e291cd0-07ad-4efc-a491-d319e306419d-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:53 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD Aug 05 10:32:53 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] Lock "cinder-4e291cd0-07ad-4efc-a491-d319e306419d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] Acquiring lock "cinder-quobyte-4e291cd0-07ad-4efc-a491-d319e306419d" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] Lock "cinder-quobyte-4e291cd0-07ad-4efc-a491-d319e306419d" acquired by "delete_volume" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[529bc06b-6c06-471a-b519-01b35163f91d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4e291cd0-07ad-4efc-a491-d319e306419d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:53 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4e291cd0-07ad-4efc-a491-d319e306419d Aug 05 10:32:53 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:53 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD" returned: 1 in 0.766s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a226ca3e-add5-46b8-9e26-b4ecfb10e859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef95fae4fb54f58ad0eb5e5087b2a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:32:50Z,use_quota=True,user_id='0709f331d15c4e0ca00444de181053ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39ef400f-6fcb-4cf2-a567-8e4a90b19511),volume_type_id=39ef400f-6fcb-4cf2-a567-8e4a90b19511)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Creating volume a226ca3e-add5-46b8-9e26-b4ecfb10e859 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:32:53 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:53 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859 1073741824 Aug 05 10:32:53 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] Acquiring lock "cinder-8f92d8a6-ff78-4f02-a216-acc445f7f561-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] Lock "cinder-8f92d8a6-ff78-4f02-a216-acc445f7f561-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] Acquiring lock "cinder-quobyte-8f92d8a6-ff78-4f02-a216-acc445f7f561" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] Lock "cinder-quobyte-8f92d8a6-ff78-4f02-a216-acc445f7f561" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acdd34f-f273-45f7-8d87-5b1e15227062]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8f92d8a6-ff78-4f02-a216-acc445f7f561 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:54 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4e291cd0-07ad-4efc-a491-d319e306419d" returned: 0 in 0.747s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4e291cd0-07ad-4efc-a491-d319e306419d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:54 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4e291cd0-07ad-4efc-a491-d319e306419d Aug 05 10:32:54 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:54 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8f92d8a6-ff78-4f02-a216-acc445f7f561 Aug 05 10:32:54 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:54 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859 1073741824" returned: 0 in 0.895s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:54 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4e291cd0-07ad-4efc-a491-d319e306419d" returned: 0 in 0.545s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] Lock "cinder-quobyte-4e291cd0-07ad-4efc-a491-d319e306419d" released by "delete_volume" :: held 1.400s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:54 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8f92d8a6-ff78-4f02-a216-acc445f7f561" returned: 0 in 0.681s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8f92d8a6-ff78-4f02-a216-acc445f7f561 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:54 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8f92d8a6-ff78-4f02-a216-acc445f7f561 Aug 05 10:32:54 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:54 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859 Aug 05 10:32:54 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:54 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] Created reservations ['c0e61598-800d-432f-8a2a-3dad4a509ea9', 'f1ed5361-9d32-4ada-9d92-7233386e2209', '7a094a7d-c57a-4e46-8ff1-fa7a21b75c87', '0594ef3d-0898-4124-b776-992c4356880d'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:55 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:32:55 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:55 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859" returned: 0 in 0.501s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Attempting download of a32e5e8b-ea24-4cd1-aa95-89cc85691d03 ((None, [{'url': 'file:///opt/stack/data/glance/images/a32e5e8b-ea24-4cd1-aa95-89cc85691d03', 'metadata': {}}])) to volume a226ca3e-add5-46b8-9e26-b4ecfb10e859. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[952f5d60-369b-46ab-a0bc-764dee60c2a8]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_gbydsk1f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:55 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8f92d8a6-ff78-4f02-a216-acc445f7f561" returned: 0 in 0.713s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:55 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.365s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] Lock "cinder-quobyte-8f92d8a6-ff78-4f02-a216-acc445f7f561" released by "delete_volume" :: held 1.486s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:55 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] Deleted volume successfully. Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-42d1898b-6d33-491a-b740-34beed44ab29 tempest-VolumesActionsTest-162847049 None] Lock "cinder-4e291cd0-07ad-4efc-a491-d319e306419d-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:55 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_gbydsk1f Aug 05 10:32:55 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] Created reservations ['0ef78ca8-23a6-40f1-be61-4dc48a735414', 'ea54af02-401f-4be4-b90b-af446e1f91f5', 'c11a7261-2eda-4252-8cac-27d730408d56', 'fbb07f83-f562-44d3-b06a-67ab8df46bd3'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:55 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:32:55 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:56 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_gbydsk1f" returned: 0 in 0.734s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_gbydsk1f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:56 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_gbydsk1f Aug 05 10:32:56 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:56 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.475s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:56 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:56 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] Deleted volume successfully. Aug 05 10:32:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] Acquiring lock "cinder-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5ee2583f-afda-43d1-be74-d779f717d7e2 tempest-ServersNegativeTestJSON-18059442 None] Lock "cinder-8f92d8a6-ff78-4f02-a216-acc445f7f561-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] Lock "cinder-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] Acquiring lock "cinder-quobyte-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:32:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] Lock "cinder-quobyte-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa" acquired by "delete_volume" :: waited 0.038s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:32:56 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfeb6dd0-af94-41a4-97a8-30989eb22087]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:56 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa Aug 05 10:32:56 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:56 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_gbydsk1f" returned: 1 in 0.680s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_gbydsk1f' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:32:56 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a267c88-fe6b-4ee8-bdac-09b73f7bfb20]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:32:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:57 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD Aug 05 10:32:57 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:57 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa" returned: 0 in 0.686s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:57 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa Aug 05 10:32:57 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:57 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD" returned: 0 in 0.702s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:57 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa" returned: 0 in 0.516s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:57 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD Aug 05 10:32:57 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] Lock "cinder-quobyte-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa" released by "delete_volume" :: held 1.302s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:57 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] Created reservations ['f161d942-f474-4aff-ad30-07708c8640ea', '1330acce-ad65-4695-8d90-54660e69320c', '5dd3f4d8-424a-449e-a502-476cf68aa259', 'b0b7f67c-2db6-4d70-a697-297263b42660'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:32:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:32:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:32:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:32:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:32:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:32:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:58 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:32:58 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:58 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD" returned: 1 in 0.861s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:32:58 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] a32e5e8b-ea24-4cd1-aa95-89cc85691d03 was raw, converting to qcow2 {{(pid=88736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:32:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:58 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859 Aug 05 10:32:58 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:32:58 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.363s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:58 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:32:58 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] Deleted volume successfully. Aug 05 10:32:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-de978c2d-a0a5-4f6c-905f-2ece123590c6 tempest-ServersNegativeTestJSON-18059442 None] Lock "cinder-b5f3ceb2-3a23-46c6-8ca9-ed28b45de2aa-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:32:59 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Aug 05 10:32:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859" returned: 0 in 1.100s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:32:59 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a32e5e8b-ea24-4cd1-aa95-89cc85691d03_s1g7352fdevstack@QuobyteHD, size 0.00 MB, duration 1.10 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859 {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:32:59 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 10:32:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:32:59 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859 1G Aug 05 10:32:59 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:00 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859 1G" returned: 0 in 0.633s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:00 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Downloaded image a32e5e8b-ea24-4cd1-aa95-89cc85691d03 ((None, [{'url': 'file:///opt/stack/data/glance/images/a32e5e8b-ea24-4cd1-aa95-89cc85691d03', 'metadata': {}}])) to volume a226ca3e-add5-46b8-9e26-b4ecfb10e859 successfully. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:33:00 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Temporary image a32e5e8b-ea24-4cd1-aa95-89cc85691d03 for user 0709f331d15c4e0ca00444de181053ad is deleted. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:33:00 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Marking volume a226ca3e-add5-46b8-9e26-b4ecfb10e859 as bootable. {{(pid=88736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:33:00 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Copying metadata from image a32e5e8b-ea24-4cd1-aa95-89cc85691d03 to a226ca3e-add5-46b8-9e26-b4ecfb10e859. {{(pid=88736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:33:00 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Creating volume glance metadata for volume a226ca3e-add5-46b8-9e26-b4ecfb10e859 backed by image a32e5e8b-ea24-4cd1-aa95-89cc85691d03 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a32e5e8b-ea24-4cd1-aa95-89cc85691d03', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7aa89a9756d11b1e959982b5171de636', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:33:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07e96ac-f5fb-4bfa-a2ba-0b47cffcd3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859', 'volume_size': 1, 'image_id': 'a32e5e8b-ea24-4cd1-aa95-89cc85691d03', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a32e5e8b-ea24-4cd1-aa95-89cc85691d03', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7aa89a9756d11b1e959982b5171de636', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ef95fae4fb54f58ad0eb5e5087b2a62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '217da43fc52d60ffcccb61c82733cd8724e5d49957de21e61b58c2dc7784cc1af94cbd921eb55787b34c33bedd040a7e986ffa546129b584210df6e8e146f1ea', 'id': 'a32e5e8b-ea24-4cd1-aa95-89cc85691d03', 'created_at': datetime.datetime(2026, 8, 5, 8, 32, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 32, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a32e5e8b-ea24-4cd1-aa95-89cc85691d03/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d953ff86-56df-4741-99bf-7ad3f0fc3dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:00 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Volume volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859 (a226ca3e-add5-46b8-9e26-b4ecfb10e859): created successfully Aug 05 10:33:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d953ff86-56df-4741-99bf-7ad3f0fc3dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Flow 'volume_create_manager' (a6bfb60a-2331-4392-8735-165d442a375c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:00 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-dc06b983-25a0-46da-a5fe-d83f34707242 tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Created volume successfully. Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Flow 'volume_create_manager' (9ce387b7-963c-429d-930b-22a1f181a9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21f0c04-23c9-48dc-bbd8-afd1396fa701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21f0c04-23c9-48dc-bbd8-afd1396fa701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-281032971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae737c2c-3d63-4e11-b5ac-840464c5aeac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee651a396e56400b8e33baef9a703420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:01Z,use_quota=True,user_id='d5c139de9fc5467e88b3ca973fb50fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9455d9d5-c29f-4a46-a9f6-815d2bccf748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9455d9d5-c29f-4a46-a9f6-815d2bccf748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720bb6d1-3204-48d5-afba-22d221bda4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720bb6d1-3204-48d5-afba-22d221bda4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae737c2c-3d63-4e11-b5ac-840464c5aeac', 'volume_name': 'volume-ae737c2c-3d63-4e11-b5ac-840464c5aeac', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f584480-0bde-42a0-9be2-32f2b87fb184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f584480-0bde-42a0-9be2-32f2b87fb184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fff0a1e-4691-4825-b944-022a1667ce1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:01 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Volume ae737c2c-3d63-4e11-b5ac-840464c5aeac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae737c2c-3d63-4e11-b5ac-840464c5aeac', 'volume_size': 1} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-281032971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae737c2c-3d63-4e11-b5ac-840464c5aeac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee651a396e56400b8e33baef9a703420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:01Z,use_quota=True,user_id='d5c139de9fc5467e88b3ca973fb50fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Creating volume ae737c2c-3d63-4e11-b5ac-840464c5aeac {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:01 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae737c2c-3d63-4e11-b5ac-840464c5aeac 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:01 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae737c2c-3d63-4e11-b5ac-840464c5aeac 1073741824 Aug 05 10:33:01 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Acquiring lock "cinder-a226ca3e-add5-46b8-9e26-b4ecfb10e859-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Lock "cinder-a226ca3e-add5-46b8-9e26-b4ecfb10e859-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Acquiring lock "cinder-quobyte-a226ca3e-add5-46b8-9e26-b4ecfb10e859" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Lock "cinder-quobyte-a226ca3e-add5-46b8-9e26-b4ecfb10e859" acquired by "delete_volume" :: waited 0.027s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca696b16-fc54-4ffd-9685-49a196a96a7f]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:01 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859 Aug 05 10:33:01 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:01 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae737c2c-3d63-4e11-b5ac-840464c5aeac 1073741824" returned: 0 in 0.679s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae737c2c-3d63-4e11-b5ac-840464c5aeac {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:02 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae737c2c-3d63-4e11-b5ac-840464c5aeac Aug 05 10:33:02 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:02 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859" returned: 0 in 0.554s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:02 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859 Aug 05 10:33:02 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:02 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae737c2c-3d63-4e11-b5ac-840464c5aeac" returned: 0 in 0.275s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fff0a1e-4691-4825-b944-022a1667ce1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae737c2c-3d63-4e11-b5ac-840464c5aeac', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d83534-02e5-4ad4-8e3d-c14cfe17bd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:02 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Volume volume-ae737c2c-3d63-4e11-b5ac-840464c5aeac (ae737c2c-3d63-4e11-b5ac-840464c5aeac): created successfully Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d83534-02e5-4ad4-8e3d-c14cfe17bd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Flow 'volume_create_manager' (9ce387b7-963c-429d-930b-22a1f181a9e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:02 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-42b73997-ae83-4dd2-935e-4288d79cfbd2 tempest-VolumesActionsTest-162847049 None] Created volume successfully. Aug 05 10:33:02 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a226ca3e-add5-46b8-9e26-b4ecfb10e859" returned: 0 in 0.319s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Lock "cinder-quobyte-a226ca3e-add5-46b8-9e26-b4ecfb10e859" released by "delete_volume" :: held 0.939s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:02 devstack cinder-volume[88736]: WARNING cinder.quota [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:33:02 devstack cinder-volume[88736]: WARNING cinder.quota [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Created reservations ['5f359d2a-5e05-4c30-851c-155ca8da0e09', '179ea0ee-0de1-419d-8264-364ca2e2d0ff', '118ca22d-4f17-4571-81b1-635e24ad237d', '9656f706-34fb-4a67-98d5-ff7780e82821'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:02 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:33:02 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:02 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.301s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:02 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:02 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Deleted volume successfully. Aug 05 10:33:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c1223e84-9e78-48ff-b91c-cd8544a9618b tempest-VolumeAndVolumeTypeFromImageTest-1441468382 None] Lock "cinder-a226ca3e-add5-46b8-9e26-b4ecfb10e859-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] Acquiring lock "cinder-ae737c2c-3d63-4e11-b5ac-840464c5aeac-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] Lock "cinder-ae737c2c-3d63-4e11-b5ac-840464c5aeac-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] Acquiring lock "cinder-quobyte-ae737c2c-3d63-4e11-b5ac-840464c5aeac" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] Lock "cinder-quobyte-ae737c2c-3d63-4e11-b5ac-840464c5aeac" acquired by "delete_volume" :: waited 0.026s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:03 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f0f7be-f67d-4117-bf14-8f0d0d41c48f]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae737c2c-3d63-4e11-b5ac-840464c5aeac {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:03 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae737c2c-3d63-4e11-b5ac-840464c5aeac Aug 05 10:33:03 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:03 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae737c2c-3d63-4e11-b5ac-840464c5aeac" returned: 0 in 0.522s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae737c2c-3d63-4e11-b5ac-840464c5aeac {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:04 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae737c2c-3d63-4e11-b5ac-840464c5aeac Aug 05 10:33:04 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:04 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae737c2c-3d63-4e11-b5ac-840464c5aeac" returned: 0 in 0.393s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] Lock "cinder-quobyte-ae737c2c-3d63-4e11-b5ac-840464c5aeac" released by "delete_volume" :: held 0.963s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:04 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] Created reservations ['34fc00ae-d247-4c75-b960-abeee60e1f3d', 'c24e00a7-6e36-4cc2-952c-a1a8292e9b1b', 'bd108937-bb09-4c22-ab73-29be7195787d', '061edc78-82f3-4b2c-9a10-15d6b60fbcd3'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:04 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:33:04 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:04 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.402s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:04 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:04 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] Deleted volume successfully. Aug 05 10:33:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f17661d6-17ed-4655-b1dc-65259e8e0ef6 tempest-VolumesActionsTest-2096564748 None] Lock "cinder-ae737c2c-3d63-4e11-b5ac-840464c5aeac-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Flow 'volume_create_manager' (fac5b0e1-d108-44d0-9d07-575cc044ddf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd58a9bf-0bb5-4172-bea5-bea34be6dadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd58a9bf-0bb5-4172-bea5-bea34be6dadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-848655389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5966a2a-c965-4d56-8666-2849e9f2ccee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee651a396e56400b8e33baef9a703420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:06Z,use_quota=True,user_id='d5c139de9fc5467e88b3ca973fb50fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8160b7-d941-4e92-82fd-7b02a68fedbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8160b7-d941-4e92-82fd-7b02a68fedbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cecc489-419e-4242-935c-f43274207b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cecc489-419e-4242-935c-f43274207b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5966a2a-c965-4d56-8666-2849e9f2ccee', 'volume_name': 'volume-c5966a2a-c965-4d56-8666-2849e9f2ccee', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c69d750-df42-4568-92ba-12d9fdf14656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c69d750-df42-4568-92ba-12d9fdf14656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a552d92-d103-473d-be24-f8aefbadc32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:06 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Volume c5966a2a-c965-4d56-8666-2849e9f2ccee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5966a2a-c965-4d56-8666-2849e9f2ccee', 'volume_size': 1} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-848655389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5966a2a-c965-4d56-8666-2849e9f2ccee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee651a396e56400b8e33baef9a703420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:06Z,use_quota=True,user_id='d5c139de9fc5467e88b3ca973fb50fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Creating volume c5966a2a-c965-4d56-8666-2849e9f2ccee {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:06 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:33:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c5966a2a-c965-4d56-8666-2849e9f2ccee 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:06 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c5966a2a-c965-4d56-8666-2849e9f2ccee 1073741824 Aug 05 10:33:06 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:07 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c5966a2a-c965-4d56-8666-2849e9f2ccee 1073741824" returned: 0 in 0.667s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c5966a2a-c965-4d56-8666-2849e9f2ccee {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:07 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c5966a2a-c965-4d56-8666-2849e9f2ccee Aug 05 10:33:07 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:07 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c5966a2a-c965-4d56-8666-2849e9f2ccee" returned: 0 in 0.361s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a552d92-d103-473d-be24-f8aefbadc32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5966a2a-c965-4d56-8666-2849e9f2ccee', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca3a5429-ef78-40fa-9fa0-7da360b4a2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:07 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Volume volume-c5966a2a-c965-4d56-8666-2849e9f2ccee (c5966a2a-c965-4d56-8666-2849e9f2ccee): created successfully Aug 05 10:33:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca3a5429-ef78-40fa-9fa0-7da360b4a2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Flow 'volume_create_manager' (fac5b0e1-d108-44d0-9d07-575cc044ddf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:07 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-92368292-b707-4118-8c40-5478593ad828 tempest-VolumesActionsTest-162847049 None] Created volume successfully. Aug 05 10:33:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] Acquiring lock "cinder-c5966a2a-c965-4d56-8666-2849e9f2ccee-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] Lock "cinder-c5966a2a-c965-4d56-8666-2849e9f2ccee-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] Acquiring lock "cinder-quobyte-c5966a2a-c965-4d56-8666-2849e9f2ccee" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] Lock "cinder-quobyte-c5966a2a-c965-4d56-8666-2849e9f2ccee" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:08 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdcf6a9-96fd-4eb1-87e1-73053754de8b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c5966a2a-c965-4d56-8666-2849e9f2ccee {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:09 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c5966a2a-c965-4d56-8666-2849e9f2ccee Aug 05 10:33:09 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:09 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c5966a2a-c965-4d56-8666-2849e9f2ccee" returned: 0 in 0.443s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c5966a2a-c965-4d56-8666-2849e9f2ccee {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:09 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c5966a2a-c965-4d56-8666-2849e9f2ccee Aug 05 10:33:09 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c5966a2a-c965-4d56-8666-2849e9f2ccee" returned: 0 in 0.282s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:09 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] Lock "cinder-quobyte-c5966a2a-c965-4d56-8666-2849e9f2ccee" released by "delete_volume" :: held 0.803s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:09 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] Created reservations ['beaea615-a93d-483d-9f9f-48f11a59ed25', 'e56d3a3c-073d-4195-87aa-32848c56f0d8', '93f66bc2-b027-4dd5-9e79-68bbbec299e1', 'f8acea49-110f-41df-bfbc-e8873b356281'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:09 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:33:09 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:10 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.299s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:10 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] Deleted volume successfully. Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f2b759b5-4aea-4cd9-8055-3d739bc23fca tempest-VolumesActionsTest-2096564748 None] Lock "cinder-c5966a2a-c965-4d56-8666-2849e9f2ccee-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Flow 'volume_create_manager' (719a9378-5f0f-4034-8e33-06585614553e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32881bc9-d849-4c21-af3b-2f25147758da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32881bc9-d849-4c21-af3b-2f25147758da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2048231597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe3afa3-9480-403c-bddd-68e93900590c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee651a396e56400b8e33baef9a703420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:10Z,use_quota=True,user_id='d5c139de9fc5467e88b3ca973fb50fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384ea1cb-86c8-456f-ac8b-61d34118a818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384ea1cb-86c8-456f-ac8b-61d34118a818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c3f27c-8d73-40f9-9863-c90f7b5ac921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c3f27c-8d73-40f9-9863-c90f7b5ac921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbe3afa3-9480-403c-bddd-68e93900590c', 'volume_name': 'volume-dbe3afa3-9480-403c-bddd-68e93900590c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9fcb10-5bba-453a-805d-ab9aa280ee70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9fcb10-5bba-453a-805d-ab9aa280ee70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355d8bd6-5fb7-46ba-9627-1682e40c8f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:10 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Volume dbe3afa3-9480-403c-bddd-68e93900590c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbe3afa3-9480-403c-bddd-68e93900590c', 'volume_size': 1} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2048231597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe3afa3-9480-403c-bddd-68e93900590c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee651a396e56400b8e33baef9a703420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:10Z,use_quota=True,user_id='d5c139de9fc5467e88b3ca973fb50fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Creating volume dbe3afa3-9480-403c-bddd-68e93900590c {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:10 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:33:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dbe3afa3-9480-403c-bddd-68e93900590c 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:10 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dbe3afa3-9480-403c-bddd-68e93900590c 1073741824 Aug 05 10:33:10 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:11 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dbe3afa3-9480-403c-bddd-68e93900590c 1073741824" returned: 0 in 0.565s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dbe3afa3-9480-403c-bddd-68e93900590c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:11 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dbe3afa3-9480-403c-bddd-68e93900590c Aug 05 10:33:11 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:11 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dbe3afa3-9480-403c-bddd-68e93900590c" returned: 0 in 0.288s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355d8bd6-5fb7-46ba-9627-1682e40c8f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe3afa3-9480-403c-bddd-68e93900590c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5b9e72-c766-47d3-a40a-7aaf5e90b448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:11 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Volume volume-dbe3afa3-9480-403c-bddd-68e93900590c (dbe3afa3-9480-403c-bddd-68e93900590c): created successfully Aug 05 10:33:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5b9e72-c766-47d3-a40a-7aaf5e90b448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Flow 'volume_create_manager' (719a9378-5f0f-4034-8e33-06585614553e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:11 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-78b62374-98fa-48e1-bc8b-0bfe01b4e6c9 tempest-VolumesActionsTest-162847049 None] Created volume successfully. Aug 05 10:33:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] Acquiring lock "cinder-dbe3afa3-9480-403c-bddd-68e93900590c-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] Lock "cinder-dbe3afa3-9480-403c-bddd-68e93900590c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] Acquiring lock "cinder-quobyte-dbe3afa3-9480-403c-bddd-68e93900590c" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] Lock "cinder-quobyte-dbe3afa3-9480-403c-bddd-68e93900590c" acquired by "delete_volume" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:12 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e75e1b-cf97-48c3-be34-bdbcd1699ea0]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dbe3afa3-9480-403c-bddd-68e93900590c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:13 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dbe3afa3-9480-403c-bddd-68e93900590c Aug 05 10:33:13 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:13 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dbe3afa3-9480-403c-bddd-68e93900590c" returned: 0 in 0.456s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dbe3afa3-9480-403c-bddd-68e93900590c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:13 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dbe3afa3-9480-403c-bddd-68e93900590c Aug 05 10:33:13 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:13 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dbe3afa3-9480-403c-bddd-68e93900590c" returned: 0 in 0.341s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] Lock "cinder-quobyte-dbe3afa3-9480-403c-bddd-68e93900590c" released by "delete_volume" :: held 0.861s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] Created reservations ['582ad40c-35e6-43dd-91e3-b844ea4baafc', '4ba0d0c8-b320-41b6-9e3a-14275065fe72', 'f9017382-52c8-4223-897f-6fd5e68933e4', '2873b468-1310-4d0c-b7d2-266340fd04f0'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:13 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:33:13 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:13 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:33:13 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:14 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.262s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:33:14 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.320s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:14 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] Deleted volume successfully. Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bd869fff-c436-47b2-9a8f-a01fdd996c09 tempest-VolumesActionsTest-2096564748 None] Lock "cinder-dbe3afa3-9480-403c-bddd-68e93900590c-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Flow 'volume_create_manager' (77d1d016-5109-4c54-b255-14492c007a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e450dd44-1523-46f2-9656-b54d26f5e860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e450dd44-1523-46f2-9656-b54d26f5e860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1549884054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a49a50c-4617-458e-91f0-5ae9b60a6ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee651a396e56400b8e33baef9a703420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:14Z,use_quota=True,user_id='d5c139de9fc5467e88b3ca973fb50fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76da21eb-8e1e-4249-9f18-78e1c1d1e7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76da21eb-8e1e-4249-9f18-78e1c1d1e7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f082ff50-92a8-47ac-b0f4-26763c9ab83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f082ff50-92a8-47ac-b0f4-26763c9ab83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a49a50c-4617-458e-91f0-5ae9b60a6ca5', 'volume_name': 'volume-9a49a50c-4617-458e-91f0-5ae9b60a6ca5', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64623d8a-5085-4de3-8dfb-5746687e9e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64623d8a-5085-4de3-8dfb-5746687e9e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffff17e4-a2a8-4a03-ad5d-34e30961ab37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:14 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Volume 9a49a50c-4617-458e-91f0-5ae9b60a6ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a49a50c-4617-458e-91f0-5ae9b60a6ca5', 'volume_size': 1} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1549884054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a49a50c-4617-458e-91f0-5ae9b60a6ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee651a396e56400b8e33baef9a703420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:14Z,use_quota=True,user_id='d5c139de9fc5467e88b3ca973fb50fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Creating volume 9a49a50c-4617-458e-91f0-5ae9b60a6ca5 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:14 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:33:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a49a50c-4617-458e-91f0-5ae9b60a6ca5 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:14 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a49a50c-4617-458e-91f0-5ae9b60a6ca5 1073741824 Aug 05 10:33:14 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:15 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a49a50c-4617-458e-91f0-5ae9b60a6ca5 1073741824" returned: 0 in 0.540s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a49a50c-4617-458e-91f0-5ae9b60a6ca5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:15 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a49a50c-4617-458e-91f0-5ae9b60a6ca5 Aug 05 10:33:15 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:15 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a49a50c-4617-458e-91f0-5ae9b60a6ca5" returned: 0 in 0.304s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffff17e4-a2a8-4a03-ad5d-34e30961ab37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a49a50c-4617-458e-91f0-5ae9b60a6ca5', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567b9092-60ee-4106-beab-8065c7546159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:15 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Volume volume-9a49a50c-4617-458e-91f0-5ae9b60a6ca5 (9a49a50c-4617-458e-91f0-5ae9b60a6ca5): created successfully Aug 05 10:33:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567b9092-60ee-4106-beab-8065c7546159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Flow 'volume_create_manager' (77d1d016-5109-4c54-b255-14492c007a64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:15 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e6ac10ca-c60a-4cb7-9ab7-aa3f3dd287f1 tempest-VolumesActionsTest-162847049 None] Created volume successfully. Aug 05 10:33:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] Acquiring lock "cinder-9a49a50c-4617-458e-91f0-5ae9b60a6ca5-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] Lock "cinder-9a49a50c-4617-458e-91f0-5ae9b60a6ca5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:16 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=86,cinder:UPDATE=98,cinder:INSERT=23,cinder:DELETE=9 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:33:16 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=71,cinder:UPDATE=98,cinder:DELETE=8,cinder:INSERT=30 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:33:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] Acquiring lock "cinder-quobyte-9a49a50c-4617-458e-91f0-5ae9b60a6ca5" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] Lock "cinder-quobyte-9a49a50c-4617-458e-91f0-5ae9b60a6ca5" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:16 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7490175c-9f56-43de-bb31-0ee31f860e2b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a49a50c-4617-458e-91f0-5ae9b60a6ca5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:17 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a49a50c-4617-458e-91f0-5ae9b60a6ca5 Aug 05 10:33:17 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:17 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a49a50c-4617-458e-91f0-5ae9b60a6ca5" returned: 0 in 0.377s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a49a50c-4617-458e-91f0-5ae9b60a6ca5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:17 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a49a50c-4617-458e-91f0-5ae9b60a6ca5 Aug 05 10:33:17 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:17 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a49a50c-4617-458e-91f0-5ae9b60a6ca5" returned: 0 in 0.255s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] Lock "cinder-quobyte-9a49a50c-4617-458e-91f0-5ae9b60a6ca5" released by "delete_volume" :: held 0.704s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:17 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] Created reservations ['118444d0-458f-4f63-91fa-b7427cdb2a92', 'b104f90b-d03f-407c-9fba-0fc4ee63038b', 'c6eccad0-f4c9-4460-8550-7ac8301cccfe', 'cc692432-9556-436c-843a-fd32eb28d458'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:17 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:33:17 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:18 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.274s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:18 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] Deleted volume successfully. Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e8f38356-e764-4aee-918a-ae2e47587276 tempest-VolumesActionsTest-2096564748 None] Lock "cinder-9a49a50c-4617-458e-91f0-5ae9b60a6ca5-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Flow 'volume_create_manager' (131cc331-36eb-4947-87b5-2ee90b09bc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7fc1106-e1e9-4743-b68b-c748fa68628a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7fc1106-e1e9-4743-b68b-c748fa68628a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-375726208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20aabef2-f7ba-4711-b629-6d3d1df6fae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee651a396e56400b8e33baef9a703420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:19Z,use_quota=True,user_id='d5c139de9fc5467e88b3ca973fb50fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765b03f2-773a-4260-8ba2-369e3f2bc54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765b03f2-773a-4260-8ba2-369e3f2bc54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da5fb3d3-3397-4857-836b-ee62c1ff9549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da5fb3d3-3397-4857-836b-ee62c1ff9549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20aabef2-f7ba-4711-b629-6d3d1df6fae1', 'volume_name': 'volume-20aabef2-f7ba-4711-b629-6d3d1df6fae1', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff27231-6bf0-4876-9bf6-1d8a55e1807c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff27231-6bf0-4876-9bf6-1d8a55e1807c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3123940f-11c6-413b-bdb1-0c459233396a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:18 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Volume 20aabef2-f7ba-4711-b629-6d3d1df6fae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20aabef2-f7ba-4711-b629-6d3d1df6fae1', 'volume_size': 1} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-375726208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20aabef2-f7ba-4711-b629-6d3d1df6fae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee651a396e56400b8e33baef9a703420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:19Z,use_quota=True,user_id='d5c139de9fc5467e88b3ca973fb50fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Creating volume 20aabef2-f7ba-4711-b629-6d3d1df6fae1 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:18 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:33:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-20aabef2-f7ba-4711-b629-6d3d1df6fae1 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:18 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-20aabef2-f7ba-4711-b629-6d3d1df6fae1 1073741824 Aug 05 10:33:18 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:19 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-20aabef2-f7ba-4711-b629-6d3d1df6fae1 1073741824" returned: 0 in 0.483s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-20aabef2-f7ba-4711-b629-6d3d1df6fae1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:19 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-20aabef2-f7ba-4711-b629-6d3d1df6fae1 Aug 05 10:33:19 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:19 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-20aabef2-f7ba-4711-b629-6d3d1df6fae1" returned: 0 in 0.278s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3123940f-11c6-413b-bdb1-0c459233396a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20aabef2-f7ba-4711-b629-6d3d1df6fae1', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809b89ed-78dc-4e00-97c0-74e7cd22f260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:19 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Volume volume-20aabef2-f7ba-4711-b629-6d3d1df6fae1 (20aabef2-f7ba-4711-b629-6d3d1df6fae1): created successfully Aug 05 10:33:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809b89ed-78dc-4e00-97c0-74e7cd22f260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Flow 'volume_create_manager' (131cc331-36eb-4947-87b5-2ee90b09bc80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:19 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-da19bcb6-8454-425d-8c98-de2137ea5d83 tempest-VolumesActionsTest-162847049 None] Created volume successfully. Aug 05 10:33:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] Acquiring lock "cinder-20aabef2-f7ba-4711-b629-6d3d1df6fae1-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] Lock "cinder-20aabef2-f7ba-4711-b629-6d3d1df6fae1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] Acquiring lock "cinder-quobyte-20aabef2-f7ba-4711-b629-6d3d1df6fae1" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] Lock "cinder-quobyte-20aabef2-f7ba-4711-b629-6d3d1df6fae1" acquired by "delete_volume" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:21 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c2ae70-0b38-47a9-bd16-5233b88f330b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-20aabef2-f7ba-4711-b629-6d3d1df6fae1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:21 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-20aabef2-f7ba-4711-b629-6d3d1df6fae1 Aug 05 10:33:21 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:21 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-20aabef2-f7ba-4711-b629-6d3d1df6fae1" returned: 0 in 0.412s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-20aabef2-f7ba-4711-b629-6d3d1df6fae1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:22 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-20aabef2-f7ba-4711-b629-6d3d1df6fae1 Aug 05 10:33:22 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:22 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-20aabef2-f7ba-4711-b629-6d3d1df6fae1" returned: 0 in 0.310s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] Lock "cinder-quobyte-20aabef2-f7ba-4711-b629-6d3d1df6fae1" released by "delete_volume" :: held 0.774s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:22 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] Created reservations ['37660252-3371-490c-bb4b-1127f41dc13a', '48f3f394-8b81-4170-81b7-6c3aef0d0d30', '0b4c7779-6217-4c24-8478-b2084c99b536', 'd853cef7-50b3-46f9-b671-1e72c95e5d23'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:22 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:33:22 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:22 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.375s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:22 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:22 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] Deleted volume successfully. Aug 05 10:33:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-38687280-e34e-461e-aeb6-8dfb4f7898a3 tempest-VolumesActionsTest-162847049 None] Lock "cinder-20aabef2-f7ba-4711-b629-6d3d1df6fae1-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:24 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-f7fe3871-b5a7-43ed-9b97-c71df14b6c2a req-a9a91f75-9ff9-41ba-b5d1-ede36003f174 tempest-TestMinimumBasicScenario-1680065990 None] Terminate volume connection completed successfully. Aug 05 10:33:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-f7fe3871-b5a7-43ed-9b97-c71df14b6c2a req-a9a91f75-9ff9-41ba-b5d1-ede36003f174 tempest-TestMinimumBasicScenario-1680065990 None] Deleting attachment 0b2b0734-b1ac-4ea8-9a8c-b3225625f940. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:33:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] Acquiring lock "cinder-9411b60d-f553-4f41-be29-b3360c7377b7-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] Lock "cinder-9411b60d-f553-4f41-be29-b3360c7377b7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] Acquiring lock "cinder-quobyte-9411b60d-f553-4f41-be29-b3360c7377b7" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] Lock "cinder-quobyte-9411b60d-f553-4f41-be29-b3360c7377b7" acquired by "delete_volume" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:24 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccfb925-03f3-47da-9518-464c6513b6cc]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9411b60d-f553-4f41-be29-b3360c7377b7 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:25 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9411b60d-f553-4f41-be29-b3360c7377b7 Aug 05 10:33:25 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:25 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9411b60d-f553-4f41-be29-b3360c7377b7" returned: 0 in 0.406s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9411b60d-f553-4f41-be29-b3360c7377b7 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:25 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9411b60d-f553-4f41-be29-b3360c7377b7 Aug 05 10:33:25 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:25 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9411b60d-f553-4f41-be29-b3360c7377b7" returned: 0 in 0.359s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] Lock "cinder-quobyte-9411b60d-f553-4f41-be29-b3360c7377b7" released by "delete_volume" :: held 0.825s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:25 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] Created reservations ['5f5bf267-f4ba-4238-ae50-683191d4ea7a', '4da1e95d-05ce-4324-aec5-ab311aa2d553', '00d1d789-75df-4e87-9729-7be5158174cd', '0f1e4799-bfda-4a39-a788-6ce6900a0280'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:25 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:33:25 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:26 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.417s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:26 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:26 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] Deleted volume successfully. Aug 05 10:33:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2d8586f1-fd28-4849-a340-0e1c6e7bcfeb tempest-TestMinimumBasicScenario-1680065990 None] Lock "cinder-9411b60d-f553-4f41-be29-b3360c7377b7-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:35 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=20,cinder:INSERT=5,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:33:36 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=15,cinder:INSERT=8,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Flow 'volume_create_manager' (7474da0e-01ad-44b7-b942-46fcba0bb1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e668d29-fe76-4246-82c6-db07417f0163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e668d29-fe76-4246-82c6-db07417f0163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-31043683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a830c717-a326-4cdc-a6d4-566452fce022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57af5ae27f3c4a4f961af4e86a2a2a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:40Z,use_quota=True,user_id='639384d47e3749bb874b66319808dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0064735-226d-4cff-98d7-0c64b813d644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0064735-226d-4cff-98d7-0c64b813d644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffd25f8-ae2e-40b8-a9c8-90c202f8a69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffd25f8-ae2e-40b8-a9c8-90c202f8a69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a830c717-a326-4cdc-a6d4-566452fce022', 'volume_name': 'volume-a830c717-a326-4cdc-a6d4-566452fce022', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5558497-f8de-4a29-835d-8aa39eacf6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5558497-f8de-4a29-835d-8aa39eacf6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559c16fe-7309-4572-b2a2-2ba470be9752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:39 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Volume a830c717-a326-4cdc-a6d4-566452fce022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a830c717-a326-4cdc-a6d4-566452fce022', 'volume_size': 1} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-31043683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a830c717-a326-4cdc-a6d4-566452fce022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57af5ae27f3c4a4f961af4e86a2a2a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:40Z,use_quota=True,user_id='639384d47e3749bb874b66319808dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Creating volume a830c717-a326-4cdc-a6d4-566452fce022 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:39 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:33:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a830c717-a326-4cdc-a6d4-566452fce022 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:40 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a830c717-a326-4cdc-a6d4-566452fce022 1073741824 Aug 05 10:33:40 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:40 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a830c717-a326-4cdc-a6d4-566452fce022 1073741824" returned: 0 in 0.480s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a830c717-a326-4cdc-a6d4-566452fce022 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:40 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a830c717-a326-4cdc-a6d4-566452fce022 Aug 05 10:33:40 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:40 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a830c717-a326-4cdc-a6d4-566452fce022" returned: 0 in 0.296s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559c16fe-7309-4572-b2a2-2ba470be9752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a830c717-a326-4cdc-a6d4-566452fce022', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37cf62e-5852-4291-9b18-68ffa2c7ce4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:40 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Volume volume-a830c717-a326-4cdc-a6d4-566452fce022 (a830c717-a326-4cdc-a6d4-566452fce022): created successfully Aug 05 10:33:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37cf62e-5852-4291-9b18-68ffa2c7ce4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Flow 'volume_create_manager' (7474da0e-01ad-44b7-b942-46fcba0bb1c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:40 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1702c298-44f7-4b91-a381-0b76bd6ade12 tempest-VolumesListAdminTestJSON-683909164 None] Created volume successfully. Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Flow 'volume_create_manager' (f0aee0c3-e879-4b18-927c-3187a7e16fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a131ff-78f6-4189-89c6-22cf9a914cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a131ff-78f6-4189-89c6-22cf9a914cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-276349731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fee1e0d-84ff-4e67-8b26-2a023005cee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57af5ae27f3c4a4f961af4e86a2a2a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:43Z,use_quota=True,user_id='639384d47e3749bb874b66319808dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79718b3c-1cf8-409a-887b-3b503e36b5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79718b3c-1cf8-409a-887b-3b503e36b5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f574df8e-3d35-48d2-a453-cad1c0444eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f574df8e-3d35-48d2-a453-cad1c0444eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fee1e0d-84ff-4e67-8b26-2a023005cee9', 'volume_name': 'volume-8fee1e0d-84ff-4e67-8b26-2a023005cee9', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134dd990-28ed-47d8-9ff8-44a2561b2532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134dd990-28ed-47d8-9ff8-44a2561b2532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74882ebf-28c7-4104-92a7-ac93d302a2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:42 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Volume 8fee1e0d-84ff-4e67-8b26-2a023005cee9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fee1e0d-84ff-4e67-8b26-2a023005cee9', 'volume_size': 1} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-276349731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fee1e0d-84ff-4e67-8b26-2a023005cee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57af5ae27f3c4a4f961af4e86a2a2a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:43Z,use_quota=True,user_id='639384d47e3749bb874b66319808dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Creating volume 8fee1e0d-84ff-4e67-8b26-2a023005cee9 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:42 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:33:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8fee1e0d-84ff-4e67-8b26-2a023005cee9 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:42 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8fee1e0d-84ff-4e67-8b26-2a023005cee9 1073741824 Aug 05 10:33:42 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:43 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8fee1e0d-84ff-4e67-8b26-2a023005cee9 1073741824" returned: 0 in 0.475s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8fee1e0d-84ff-4e67-8b26-2a023005cee9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:43 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8fee1e0d-84ff-4e67-8b26-2a023005cee9 Aug 05 10:33:43 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:43 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8fee1e0d-84ff-4e67-8b26-2a023005cee9" returned: 0 in 0.298s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74882ebf-28c7-4104-92a7-ac93d302a2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fee1e0d-84ff-4e67-8b26-2a023005cee9', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403b5139-c77b-4aea-b1b0-b43e2cf7bd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:43 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Volume volume-8fee1e0d-84ff-4e67-8b26-2a023005cee9 (8fee1e0d-84ff-4e67-8b26-2a023005cee9): created successfully Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403b5139-c77b-4aea-b1b0-b43e2cf7bd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Flow 'volume_create_manager' (f0aee0c3-e879-4b18-927c-3187a7e16fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:43 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a1b2edf5-7548-49a2-b16d-65890757465b tempest-VolumesListAdminTestJSON-683909164 None] Created volume successfully. Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Flow 'volume_create_manager' (783ade78-c067-4c52-9133-1fb6f6df3b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b175ff-ae45-4f7f-bf0b-2b503990ac70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b175ff-ae45-4f7f-bf0b-2b503990ac70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1881574263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535d3586-8b26-4ff6-aaa7-62c45b13edfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1079eff3160842ec899588401a83299f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:44Z,use_quota=True,user_id='b95ff8563ff249be874d41d6890d413e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38cc7c7a-456b-487e-ab83-5f159b3d7f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38cc7c7a-456b-487e-ab83-5f159b3d7f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f6bc95-bc8a-490e-8b7b-e5c5624b2dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f6bc95-bc8a-490e-8b7b-e5c5624b2dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '535d3586-8b26-4ff6-aaa7-62c45b13edfd', 'volume_name': 'volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d112b30-e6c4-4ef4-8d3e-7ac3600ac7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d112b30-e6c4-4ef4-8d3e-7ac3600ac7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4039f9-9591-483c-947d-98b630a891bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:43 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Volume 535d3586-8b26-4ff6-aaa7-62c45b13edfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd', 'volume_size': 1} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1881574263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535d3586-8b26-4ff6-aaa7-62c45b13edfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1079eff3160842ec899588401a83299f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:44Z,use_quota=True,user_id='b95ff8563ff249be874d41d6890d413e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Creating volume 535d3586-8b26-4ff6-aaa7-62c45b13edfd {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:43 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:33:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:43 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd 1073741824 Aug 05 10:33:43 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:44 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd 1073741824" returned: 0 in 0.406s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:44 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd Aug 05 10:33:44 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:44 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd" returned: 0 in 0.249s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4039f9-9591-483c-947d-98b630a891bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a635a701-40c5-46d7-95db-477384283c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:44 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Volume volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd (535d3586-8b26-4ff6-aaa7-62c45b13edfd): created successfully Aug 05 10:33:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a635a701-40c5-46d7-95db-477384283c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Flow 'volume_create_manager' (783ade78-c067-4c52-9133-1fb6f6df3b91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:44 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-35588828-4ac4-46c8-98b0-4a0629cd9032 tempest-VolumeDependencyTests-1130716407 None] Created volume successfully. Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] Creating offline snapshot b2f904a7-badc-4e52-8884-63f483014093 of volume 535d3586-8b26-4ff6-aaa7-62c45b13edfd {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4733c8b8-571a-4471-ad42-d370fa9c6bf6]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:45 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd Aug 05 10:33:45 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Flow 'volume_create_manager' (5112579a-b7d5-4eb6-bd91-af9e5b418be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427263b1-dd61-404e-a671-771cd003676b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427263b1-dd61-404e-a671-771cd003676b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1039288543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86650587-ad37-4f3a-ae34-da9393bbfbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57af5ae27f3c4a4f961af4e86a2a2a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:45Z,use_quota=True,user_id='639384d47e3749bb874b66319808dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8401cb25-5257-4719-8f13-97650f3ea76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8401cb25-5257-4719-8f13-97650f3ea76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac7d62b-10af-41cc-8457-f0778c2bc12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac7d62b-10af-41cc-8457-f0778c2bc12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86650587-ad37-4f3a-ae34-da9393bbfbda', 'volume_name': 'volume-86650587-ad37-4f3a-ae34-da9393bbfbda', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f2bd1b-19a8-4b0e-a723-3f9af4f8ef5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f2bd1b-19a8-4b0e-a723-3f9af4f8ef5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00db399-4bf3-4d84-800b-2576798a6e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:45 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Volume 86650587-ad37-4f3a-ae34-da9393bbfbda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86650587-ad37-4f3a-ae34-da9393bbfbda', 'volume_size': 1} Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:45 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd" returned: 0 in 0.422s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:45 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093 1G Aug 05 10:33:45 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:45 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093 1G" returned: 0 in 0.400s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:45 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093 Aug 05 10:33:45 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:46 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093" returned: 0 in 0.288s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:46 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093 is being set with open permissions: ugo+rw Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:46 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093 Aug 05 10:33:46 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:46 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093" returned: 0 in 0.268s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:46 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.info Aug 05 10:33:46 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:46 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.info" returned: 0 in 0.253s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:46 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.info is being set with open permissions: ugo+rw Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:46 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.info Aug 05 10:33:46 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:46 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.info" returned: 0 in 0.233s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.555s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1039288543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86650587-ad37-4f3a-ae34-da9393bbfbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57af5ae27f3c4a4f961af4e86a2a2a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:45Z,use_quota=True,user_id='639384d47e3749bb874b66319808dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Creating volume 86650587-ad37-4f3a-ae34-da9393bbfbda {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:46 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:33:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-86650587-ad37-4f3a-ae34-da9393bbfbda 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:47 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-86650587-ad37-4f3a-ae34-da9393bbfbda 1073741824 Aug 05 10:33:47 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:47 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-eda74c2f-0192-4796-a95a-2a964ae6af2c tempest-VolumeDependencyTests-1130716407 None] Create snapshot completed successfully Aug 05 10:33:47 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-86650587-ad37-4f3a-ae34-da9393bbfbda 1073741824" returned: 0 in 0.461s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-86650587-ad37-4f3a-ae34-da9393bbfbda {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:47 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-86650587-ad37-4f3a-ae34-da9393bbfbda Aug 05 10:33:47 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:47 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-86650587-ad37-4f3a-ae34-da9393bbfbda" returned: 0 in 0.254s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00db399-4bf3-4d84-800b-2576798a6e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86650587-ad37-4f3a-ae34-da9393bbfbda', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4b4546-d6ab-4e7a-a1cb-3367fa4b7e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:47 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Volume volume-86650587-ad37-4f3a-ae34-da9393bbfbda (86650587-ad37-4f3a-ae34-da9393bbfbda): created successfully Aug 05 10:33:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4b4546-d6ab-4e7a-a1cb-3367fa4b7e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Flow 'volume_create_manager' (5112579a-b7d5-4eb6-bd91-af9e5b418be9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:47 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ec404767-3f8c-4fb0-a650-9a33fe8aebbf tempest-VolumesListAdminTestJSON-683909164 None] Created volume successfully. Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Flow 'volume_create_manager' (c03f038d-ae2b-40d6-8414-77c5e5c5582e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7a34ca-1fa0-4ca3-af9c-cae7d301691d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7a34ca-1fa0-4ca3-af9c-cae7d301691d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1807278701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f276847e-ff0a-4f31-814e-a6251cca1517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1079eff3160842ec899588401a83299f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b2f904a7-badc-4e52-8884-63f483014093,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:49Z,use_quota=True,user_id='b95ff8563ff249be874d41d6890d413e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59939ac0-2bf2-4d06-b396-accafaba4bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59939ac0-2bf2-4d06-b396-accafaba4bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7189e043-aea7-4eac-a573-662984512116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7189e043-aea7-4eac-a573-662984512116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f276847e-ff0a-4f31-814e-a6251cca1517', 'volume_name': 'volume-f276847e-ff0a-4f31-814e-a6251cca1517', 'volume_size': 1, 'snapshot_id': 'b2f904a7-badc-4e52-8884-63f483014093'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59eee8a-ccfc-4a66-816c-98763cbecc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59eee8a-ccfc-4a66-816c-98763cbecc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f60c36-9105-4734-a583-94c089b53370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:48 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Volume f276847e-ff0a-4f31-814e-a6251cca1517: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f276847e-ff0a-4f31-814e-a6251cca1517', 'volume_size': 1, 'snapshot_id': 'b2f904a7-badc-4e52-8884-63f483014093'} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Acquiring lock "cinder-quobyte-b2f904a7-badc-4e52-8884-63f483014093-f276847e-ff0a-4f31-814e-a6251cca1517" by "_create_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-quobyte-b2f904a7-badc-4e52-8884-63f483014093-f276847e-ff0a-4f31-814e-a6251cca1517" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Creating volume f276847e-ff0a-4f31-814e-a6251cca1517 from snapshot b2f904a7-badc-4e52-8884-63f483014093 {{(pid=88736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Acquiring lock "cinder-quobyte-f276847e-ff0a-4f31-814e-a6251cca1517" by "_copy_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-quobyte-f276847e-ff0a-4f31-814e-a6251cca1517" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] snapshot: b2f904a7-badc-4e52-8884-63f483014093, volume: f276847e-ff0a-4f31-814e-a6251cca1517, {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8addb50-c03b-44d6-b425-f3365c07ec53]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:48 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093 Aug 05 10:33:48 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:49 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Flow 'volume_create_manager' (460c6784-20b7-4ecd-8970-1dd3f37af0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63545d1e-8130-4716-b6a0-d9f33a210325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093" returned: 0 in 0.422s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63545d1e-8130-4716-b6a0-d9f33a210325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e444fa86-207a-4d34-ac3b-430ad69aa02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ded31487154245a9280939013c4afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:49Z,use_quota=True,user_id='bff05981bc5044b2a3f4c42d6480d724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a878f9d-426b-4d98-bb03-7932f2469b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a878f9d-426b-4d98-bb03-7932f2469b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e1af3f-0ee6-4383-af9b-4be023c1ec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e1af3f-0ee6-4383-af9b-4be023c1ec4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e444fa86-207a-4d34-ac3b-430ad69aa02b', 'volume_name': 'volume-e444fa86-207a-4d34-ac3b-430ad69aa02b', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8339f2bc-914a-4e8e-84c2-72de598686b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8339f2bc-914a-4e8e-84c2-72de598686b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f6cd84-2f3f-4a68-b29f-fd96b6cd0a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:49 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Volume e444fa86-207a-4d34-ac3b-430ad69aa02b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e444fa86-207a-4d34-ac3b-430ad69aa02b', 'volume_size': 1} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf7c43a-e39e-4ff8-98bf-eca677b82103]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:49 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd Aug 05 10:33:49 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:49 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd" returned: 0 in 0.356s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] will copy from snapshot at /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Creating direct copy from snapshot {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG cinder.utils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Path /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f276847e-ff0a-4f31-814e-a6251cca1517 not found in is_blk_device check {{(pid=88736) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:33:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f276847e-ff0a-4f31-814e-a6251cca1517 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:49 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f276847e-ff0a-4f31-814e-a6251cca1517 Aug 05 10:33:49 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:53 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f276847e-ff0a-4f31-814e-a6251cca1517" returned: 0 in 4.181s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:53 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Image conversion details: src /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd, size 1024.00 MB, duration 4.18 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f276847e-ff0a-4f31-814e-a6251cca1517 {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:33:53 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Converted 1024.00 MB image at 244.87 MB/s Aug 05 10:33:53 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f276847e-ff0a-4f31-814e-a6251cca1517 is being set with open permissions: ugo+rw Aug 05 10:33:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f276847e-ff0a-4f31-814e-a6251cca1517 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:53 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f276847e-ff0a-4f31-814e-a6251cca1517 Aug 05 10:33:53 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:54 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f276847e-ff0a-4f31-814e-a6251cca1517" returned: 0 in 0.238s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-quobyte-f276847e-ff0a-4f31-814e-a6251cca1517" released by "_copy_volume_from_snapshot" :: held 5.329s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-quobyte-b2f904a7-badc-4e52-8884-63f483014093-f276847e-ff0a-4f31-814e-a6251cca1517" released by "_create_volume_from_snapshot" :: held 5.392s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.407s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.840s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e444fa86-207a-4d34-ac3b-430ad69aa02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ded31487154245a9280939013c4afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:49Z,use_quota=True,user_id='bff05981bc5044b2a3f4c42d6480d724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Creating volume e444fa86-207a-4d34-ac3b-430ad69aa02b {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:54 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e444fa86-207a-4d34-ac3b-430ad69aa02b 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:54 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e444fa86-207a-4d34-ac3b-430ad69aa02b 1073741824 Aug 05 10:33:54 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f60c36-9105-4734-a583-94c089b53370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f276847e-ff0a-4f31-814e-a6251cca1517', 'volume_size': 1, 'snapshot_id': 'b2f904a7-badc-4e52-8884-63f483014093'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7339932e-7253-4890-81eb-ee138587f1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:54 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Volume volume-f276847e-ff0a-4f31-814e-a6251cca1517 (f276847e-ff0a-4f31-814e-a6251cca1517): created successfully Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7339932e-7253-4890-81eb-ee138587f1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Flow 'volume_create_manager' (c03f038d-ae2b-40d6-8414-77c5e5c5582e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:54 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-96ddc5c3-1f06-435b-a7e6-63eb3649f78f tempest-VolumeDependencyTests-1130716407 None] Created volume successfully. Aug 05 10:33:54 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e444fa86-207a-4d34-ac3b-430ad69aa02b 1073741824" returned: 0 in 0.407s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e444fa86-207a-4d34-ac3b-430ad69aa02b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:54 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e444fa86-207a-4d34-ac3b-430ad69aa02b Aug 05 10:33:54 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:54 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e444fa86-207a-4d34-ac3b-430ad69aa02b" returned: 0 in 0.233s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f6cd84-2f3f-4a68-b29f-fd96b6cd0a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e444fa86-207a-4d34-ac3b-430ad69aa02b', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2dbff74-55e2-4480-a4f5-e2fe7e081bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:54 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Volume volume-e444fa86-207a-4d34-ac3b-430ad69aa02b (e444fa86-207a-4d34-ac3b-430ad69aa02b): created successfully Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2dbff74-55e2-4480-a4f5-e2fe7e081bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Flow 'volume_create_manager' (460c6784-20b7-4ecd-8970-1dd3f37af0dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:54 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-15f3206c-a958-48bd-b902-71dbf7b5e45f tempest-VolumesListAdminTestJSON-193720683 None] Created volume successfully. Aug 05 10:33:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] Acquiring lock "cinder-b2f904a7-badc-4e52-8884-63f483014093-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-b2f904a7-badc-4e52-8884-63f483014093-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] Acquiring lock "cinder-quobyte-535d3586-8b26-4ff6-aaa7-62c45b13edfd" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-quobyte-535d3586-8b26-4ff6-aaa7-62c45b13edfd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] Acquiring lock "cinder-quobyte-b2f904a7-badc-4e52-8884-63f483014093" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-quobyte-b2f904a7-badc-4e52-8884-63f483014093" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] Deleting offline snapshot b2f904a7-badc-4e52-8884-63f483014093 of volume 535d3586-8b26-4ff6-aaa7-62c45b13edfd {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:33:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] snapshot_file for this snap is: volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:33:55 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5c7710-f9ca-43bb-a43d-223d732ffae9]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:55 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093 Aug 05 10:33:55 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:55 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093" returned: 0 in 0.356s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:33:55 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac988dde-ae45-4872-a1a8-9ecd52e5f74d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:55 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd Aug 05 10:33:55 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] Acquiring lock "cinder-e444fa86-207a-4d34-ac3b-430ad69aa02b-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] Lock "cinder-e444fa86-207a-4d34-ac3b-430ad69aa02b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] Acquiring lock "cinder-quobyte-e444fa86-207a-4d34-ac3b-430ad69aa02b" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] Lock "cinder-quobyte-e444fa86-207a-4d34-ac3b-430ad69aa02b" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:56 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd" returned: 0 in 0.518s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce39a76e-85fe-4a56-9a4c-11349ed13593]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e444fa86-207a-4d34-ac3b-430ad69aa02b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:56 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093 Aug 05 10:33:56 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] Acquiring lock "cinder-86650587-ad37-4f3a-ae34-da9393bbfbda-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] Lock "cinder-86650587-ad37-4f3a-ae34-da9393bbfbda-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] Acquiring lock "cinder-quobyte-86650587-ad37-4f3a-ae34-da9393bbfbda" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] Lock "cinder-quobyte-86650587-ad37-4f3a-ae34-da9393bbfbda" acquired by "delete_volume" :: waited 0.026s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:56 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e444fa86-207a-4d34-ac3b-430ad69aa02b Aug 05 10:33:56 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6969c4bc-f615-4d2c-b9ed-6a4ad0e4abda]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-86650587-ad37-4f3a-ae34-da9393bbfbda {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:56 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-86650587-ad37-4f3a-ae34-da9393bbfbda Aug 05 10:33:56 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:56 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093" returned: 0 in 0.388s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:56 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093 Aug 05 10:33:56 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:56 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e444fa86-207a-4d34-ac3b-430ad69aa02b" returned: 0 in 0.420s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e444fa86-207a-4d34-ac3b-430ad69aa02b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:56 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e444fa86-207a-4d34-ac3b-430ad69aa02b Aug 05 10:33:56 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:56 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-86650587-ad37-4f3a-ae34-da9393bbfbda" returned: 0 in 0.400s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-86650587-ad37-4f3a-ae34-da9393bbfbda {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:56 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-86650587-ad37-4f3a-ae34-da9393bbfbda Aug 05 10:33:56 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:56 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd.b2f904a7-badc-4e52-8884-63f483014093" returned: 0 in 0.262s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:56 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-quobyte-b2f904a7-badc-4e52-8884-63f483014093" released by "_delete_snapshot" :: held 1.624s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-quobyte-535d3586-8b26-4ff6-aaa7-62c45b13edfd" released by "delete_snapshot" :: held 1.646s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e444fa86-207a-4d34-ac3b-430ad69aa02b" returned: 0 in 0.272s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] Lock "cinder-quobyte-e444fa86-207a-4d34-ac3b-430ad69aa02b" released by "delete_volume" :: held 0.747s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] Created reservations ['ebf8dfd7-2292-4490-90ec-36022c491a28', '5612d07b-7a16-4859-be34-ff35a8d24a9a', 'f135bef8-5841-4151-a436-996d929165fb', '1374e48a-11d1-4ff0-97f0-0dd0fafffb0e'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] Created reservations ['089855aa-344f-472d-995f-cd5441ec3ff5', '8484f312-c31e-49e4-be6f-b5340553c367', '5ae03cbc-d535-42f8-af48-6378a9a7932a', '54c15061-e1c6-4dfd-8016-125044c1de8b'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:56 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-86650587-ad37-4f3a-ae34-da9393bbfbda" returned: 0 in 0.274s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:57 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] Delete snapshot completed successfully. Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] Lock "cinder-quobyte-86650587-ad37-4f3a-ae34-da9393bbfbda" released by "delete_volume" :: held 0.728s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-10c30caa-e1a7-4318-92a5-b0aa4f1b37be tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-b2f904a7-badc-4e52-8884-63f483014093-delete_snapshot" released by "delete_snapshot" :: held 1.844s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:57 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:33:57 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] Created reservations ['89755efc-be15-4870-b87a-88eedc2b992d', '7d7100b0-091f-429c-83c8-2b15f7dedf8f', '86cfa127-ccb7-4ff6-9b04-ceb87763bdef', '15aa8149-ad17-4240-83dc-fe7f60133b54'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:57 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:33:57 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:57 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.260s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:57 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] Deleted volume successfully. Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] Acquiring lock "cinder-535d3586-8b26-4ff6-aaa7-62c45b13edfd-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ccb00cb8-5d9c-4ae3-8837-b7b59791e086 tempest-VolumesListAdminTestJSON-193720683 None] Lock "cinder-e444fa86-207a-4d34-ac3b-430ad69aa02b-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-535d3586-8b26-4ff6-aaa7-62c45b13edfd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:57 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.263s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:57 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] Deleted volume successfully. Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] Acquiring lock "cinder-quobyte-535d3586-8b26-4ff6-aaa7-62c45b13edfd" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-630bd90c-a790-47b7-98c8-2b7236a9683f tempest-VolumesListAdminTestJSON-683909164 None] Lock "cinder-86650587-ad37-4f3a-ae34-da9393bbfbda-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-quobyte-535d3586-8b26-4ff6-aaa7-62c45b13edfd" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f03b52e-56fc-4e82-a8f1-5e9addbdfa45]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] Acquiring lock "cinder-8fee1e0d-84ff-4e67-8b26-2a023005cee9-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] Lock "cinder-8fee1e0d-84ff-4e67-8b26-2a023005cee9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] Acquiring lock "cinder-quobyte-8fee1e0d-84ff-4e67-8b26-2a023005cee9" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] Lock "cinder-quobyte-8fee1e0d-84ff-4e67-8b26-2a023005cee9" acquired by "delete_volume" :: waited 0.014s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c774636-8c50-4aa6-a7b8-c34368b9995a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8fee1e0d-84ff-4e67-8b26-2a023005cee9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:57 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd Aug 05 10:33:57 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:57 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8fee1e0d-84ff-4e67-8b26-2a023005cee9 Aug 05 10:33:57 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:57 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd" returned: 0 in 0.370s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:57 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd Aug 05 10:33:57 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:57 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8fee1e0d-84ff-4e67-8b26-2a023005cee9" returned: 0 in 0.343s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8fee1e0d-84ff-4e67-8b26-2a023005cee9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:57 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8fee1e0d-84ff-4e67-8b26-2a023005cee9 Aug 05 10:33:57 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:58 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-535d3586-8b26-4ff6-aaa7-62c45b13edfd" returned: 0 in 0.270s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-quobyte-535d3586-8b26-4ff6-aaa7-62c45b13edfd" released by "delete_volume" :: held 0.725s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:58 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8fee1e0d-84ff-4e67-8b26-2a023005cee9" returned: 0 in 0.278s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] Created reservations ['21f84253-ae22-42f5-ad12-7ee4b37c3eef', 'fe83ccc7-e58e-4c54-822e-90516f522ba8', 'fef8b826-6898-4f08-9bb0-b09aed128581', 'ca9a094d-c4d0-43e8-add2-01eaab9f8c43'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] Lock "cinder-quobyte-8fee1e0d-84ff-4e67-8b26-2a023005cee9" released by "delete_volume" :: held 0.670s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:58 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:33:58 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] Created reservations ['d7db86c6-c107-45fd-a22b-91c0c3fbee48', 'a0c50960-513f-48c1-995e-67c3dafea155', '3bb17ba2-a6cf-45fd-a81c-679248b94740', 'be8e515c-1503-4f5b-8b86-e476d20b34bf'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] Acquiring lock "cinder-f276847e-ff0a-4f31-814e-a6251cca1517-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:58 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:33:58 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-f276847e-ff0a-4f31-814e-a6251cca1517-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] Acquiring lock "cinder-quobyte-f276847e-ff0a-4f31-814e-a6251cca1517" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:58 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.373s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-quobyte-f276847e-ff0a-4f31-814e-a6251cca1517" acquired by "delete_volume" :: waited 0.034s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:58 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] Deleted volume successfully. Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[787f5c88-f917-492b-ad9e-edceb7564dfa]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f276847e-ff0a-4f31-814e-a6251cca1517 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-52c73da2-2099-483c-900c-12515e64bbfc tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-535d3586-8b26-4ff6-aaa7-62c45b13edfd-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:58 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.362s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:33:58 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] Deleted volume successfully. Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] Acquiring lock "cinder-a830c717-a326-4cdc-a6d4-566452fce022-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-87e6aa58-daba-492e-b8c5-cee5165209bd tempest-VolumesListAdminTestJSON-683909164 None] Lock "cinder-8fee1e0d-84ff-4e67-8b26-2a023005cee9-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] Lock "cinder-a830c717-a326-4cdc-a6d4-566452fce022-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:59 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f276847e-ff0a-4f31-814e-a6251cca1517 Aug 05 10:33:59 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] Acquiring lock "cinder-quobyte-a830c717-a326-4cdc-a6d4-566452fce022" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] Lock "cinder-quobyte-a830c717-a326-4cdc-a6d4-566452fce022" acquired by "delete_volume" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a4aa21-6a28-45d0-9745-660c702a941c]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a830c717-a326-4cdc-a6d4-566452fce022 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:59 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a830c717-a326-4cdc-a6d4-566452fce022 Aug 05 10:33:59 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:59 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f276847e-ff0a-4f31-814e-a6251cca1517" returned: 0 in 0.538s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f276847e-ff0a-4f31-814e-a6251cca1517 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:59 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f276847e-ff0a-4f31-814e-a6251cca1517 Aug 05 10:33:59 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Flow 'volume_create_manager' (614cbe3f-0be6-45a8-949f-1da7bb7f1262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658459ce-f3cf-4c37-b1c1-f27b70e30f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658459ce-f3cf-4c37-b1c1-f27b70e30f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-922820731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073e0d88-c27c-4db2-b425-f62a3247174a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc72cdd3c3543de89634a27f5ffcd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:59Z,use_quota=True,user_id='9fc2e916719f4c47bf039bef25f0aefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1394ae-6a58-4575-b485-5f640298aa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1394ae-6a58-4575-b485-5f640298aa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b78b25-61b9-4461-996f-001737e8ad21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b78b25-61b9-4461-996f-001737e8ad21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '073e0d88-c27c-4db2-b425-f62a3247174a', 'volume_name': 'volume-073e0d88-c27c-4db2-b425-f62a3247174a', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd331029-86a8-4d93-baf8-0791d5c4249f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd331029-86a8-4d93-baf8-0791d5c4249f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf24b3f-f292-47ec-96e4-be663cc9038f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:33:59 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Volume 073e0d88-c27c-4db2-b425-f62a3247174a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-073e0d88-c27c-4db2-b425-f62a3247174a', 'volume_size': 1} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-922820731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073e0d88-c27c-4db2-b425-f62a3247174a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc72cdd3c3543de89634a27f5ffcd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:33:59Z,use_quota=True,user_id='9fc2e916719f4c47bf039bef25f0aefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Creating volume 073e0d88-c27c-4db2-b425-f62a3247174a {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:33:59 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-073e0d88-c27c-4db2-b425-f62a3247174a 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:59 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a830c717-a326-4cdc-a6d4-566452fce022" returned: 0 in 0.446s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a830c717-a326-4cdc-a6d4-566452fce022 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:59 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-073e0d88-c27c-4db2-b425-f62a3247174a 1073741824 Aug 05 10:33:59 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:59 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a830c717-a326-4cdc-a6d4-566452fce022 Aug 05 10:33:59 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:59 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f276847e-ff0a-4f31-814e-a6251cca1517" returned: 0 in 0.268s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-quobyte-f276847e-ff0a-4f31-814e-a6251cca1517" released by "delete_volume" :: held 0.878s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] Created reservations ['0d2e6ada-1686-4522-92fb-b9a52c4fc738', 'b320fa6e-bddd-4ce4-a974-2b118e1cac31', '3de86ce8-1c5a-4208-ac7f-25ef3907f3f2', '9a1c1fb6-3bad-41aa-a5f5-484213479283'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:59 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a830c717-a326-4cdc-a6d4-566452fce022" returned: 0 in 0.275s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:33:59 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:33:59 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] Lock "cinder-quobyte-a830c717-a326-4cdc-a6d4-566452fce022" released by "delete_volume" :: held 0.768s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] Created reservations ['fac8734a-381d-42a4-8e0c-49bae6bf37fc', '2c0812b5-1a2d-499a-9bf1-2ccd2f5d4fda', '2e7bf48c-31a3-4edf-93f4-40e3b40e4259', '2367519e-bd51-41f6-99d4-dfcbe6f6756c'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:33:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:33:59 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:33:59 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:00 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:00 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-073e0d88-c27c-4db2-b425-f62a3247174a 1073741824" returned: 0 in 0.527s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.264s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:00 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:00 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] Deleted volume successfully. Aug 05 10:34:00 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c1d9b9f9-d15e-40e7-936a-650704303dbd tempest-VolumeDependencyTests-1130716407 None] Lock "cinder-f276847e-ff0a-4f31-814e-a6251cca1517-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-073e0d88-c27c-4db2-b425-f62a3247174a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:00 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-073e0d88-c27c-4db2-b425-f62a3247174a Aug 05 10:34:00 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:00 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.287s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:00 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:00 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] Deleted volume successfully. Aug 05 10:34:00 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a17e108b-7c89-42f9-91d8-f7b1607991da tempest-VolumesListAdminTestJSON-683909164 None] Lock "cinder-a830c717-a326-4cdc-a6d4-566452fce022-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:00 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-073e0d88-c27c-4db2-b425-f62a3247174a" returned: 0 in 0.288s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:34:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf24b3f-f292-47ec-96e4-be663cc9038f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-073e0d88-c27c-4db2-b425-f62a3247174a', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2beed73b-0373-4c0a-bb71-84e2b653ee7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:00 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Volume volume-073e0d88-c27c-4db2-b425-f62a3247174a (073e0d88-c27c-4db2-b425-f62a3247174a): created successfully Aug 05 10:34:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2beed73b-0373-4c0a-bb71-84e2b653ee7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Flow 'volume_create_manager' (614cbe3f-0be6-45a8-949f-1da7bb7f1262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:00 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-574a5c8b-c470-4550-a051-0fd61bd72c09 tempest-AttachVolumeTestJSON-1541903996 None] Created volume successfully. Aug 05 10:34:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-ee0b3b86-c64b-4bde-ac6e-b410f1dc7957 req-0130316f-f2f4-4af5-9910-f20e48f14c44 tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-ee0b3b86-c64b-4bde-ac6e-b410f1dc7957 req-0130316f-f2f4-4af5-9910-f20e48f14c44 tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-ee0b3b86-c64b-4bde-ac6e-b410f1dc7957 req-0130316f-f2f4-4af5-9910-f20e48f14c44 tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-ee0b3b86-c64b-4bde-ac6e-b410f1dc7957 req-0130316f-f2f4-4af5-9910-f20e48f14c44 tempest-AttachVolumeTestJSON-1541903996 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-073e0d88-c27c-4db2-b425-f62a3247174a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c2b0b07-3430-4cdb-86ab-61e1be367384', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:34:02 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-ee0b3b86-c64b-4bde-ac6e-b410f1dc7957 req-0130316f-f2f4-4af5-9910-f20e48f14c44 tempest-AttachVolumeTestJSON-1541903996 None] attachment_update completed successfully. Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Flow 'volume_create_manager' (bdde39f9-cd14-40ef-b3f8-31edef321477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbeaa63-ace6-483c-bf0f-978bcb581fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbeaa63-ace6-483c-bf0f-978bcb581fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-250883311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e03f0d3f7ef84dab9010f8ca10c2ae42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:05Z,use_quota=True,user_id='20432cb5c5c9494ea4f062a19058d048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7799dc-0715-4ae8-95b6-1da350ab283f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7799dc-0715-4ae8-95b6-1da350ab283f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d013dd68-d1c9-4e36-b218-f8f308f6d4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d013dd68-d1c9-4e36-b218-f8f308f6d4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5', 'volume_name': 'volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a234098-c4c2-49b6-868c-59c5bbbfc055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a234098-c4c2-49b6-868c-59c5bbbfc055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b2addd-7e64-4e8c-aa0c-29e9ba8df8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:05 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Volume dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5', 'volume_size': 1} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-250883311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e03f0d3f7ef84dab9010f8ca10c2ae42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:05Z,use_quota=True,user_id='20432cb5c5c9494ea4f062a19058d048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Creating volume dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:34:05 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:05 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 1073741824 Aug 05 10:34:05 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:05 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 1073741824" returned: 0 in 0.503s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:05 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 Aug 05 10:34:05 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:06 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5" returned: 0 in 0.256s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:34:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b2addd-7e64-4e8c-aa0c-29e9ba8df8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6618166c-dc69-454c-bbbd-1f77388f278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:06 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Volume volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 (dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5): created successfully Aug 05 10:34:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6618166c-dc69-454c-bbbd-1f77388f278b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Flow 'volume_create_manager' (bdde39f9-cd14-40ef-b3f8-31edef321477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:06 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-fd8601b5-9a8f-417c-8dc1-53a3333d5f9a tempest-SnapshotMetadataTestJSON-201019713 None] Created volume successfully. Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Flow 'volume_create_manager' (e771f55a-a89b-44ca-bf70-a4d8e1c4bd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb2f2b3-ca0f-47da-a917-9759e6fa3320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb2f2b3-ca0f-47da-a917-9759e6fa3320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba8367c-cd50-48fa-b96d-19d50a5edf72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c682ed44283d46179bea3d3f238f41e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:07Z,use_quota=True,user_id='1efc2271b51b4b7e94a3cfa621986fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e9fc8c-d295-4bb2-b24e-20cdb121cbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e9fc8c-d295-4bb2-b24e-20cdb121cbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29049ac-e5dc-4a64-a546-52b7c213f1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG cinder.image.glance [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Creating Keystone auth plugin from conf {{(pid=88736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29049ac-e5dc-4a64-a546-52b7c213f1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fba8367c-cd50-48fa-b96d-19d50a5edf72', 'volume_name': 'volume-fba8367c-cd50-48fa-b96d-19d50a5edf72', 'volume_size': 1, 'image_id': 'e4210ac1-3c9b-4603-a60c-73de8175ac97', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4210ac1-3c9b-4603-a60c-73de8175ac97', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6e0799138a1164dad81da5076324ba27', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c682ed44283d46179bea3d3f238f41e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77735e6d354c3b5b890c0d82194d7557cf205d397ea126fa9b89b2b6a0d86b61423fb21c4840fef91f046932e477dc4cc74a33b3e69fade6a5f09732f110b2d8', 'id': 'e4210ac1-3c9b-4603-a60c-73de8175ac97', 'created_at': datetime.datetime(2026, 8, 5, 8, 34, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 34, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4210ac1-3c9b-4603-a60c-73de8175ac97/file', 'properties': {}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a5c0a01-4222-4319-9713-6bb745a69680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a5c0a01-4222-4319-9713-6bb745a69680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90bf2f7a-bd3d-4f22-9f2d-085905f3629b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:07 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Volume fba8367c-cd50-48fa-b96d-19d50a5edf72: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fba8367c-cd50-48fa-b96d-19d50a5edf72', 'volume_size': 1, 'image_id': 'e4210ac1-3c9b-4603-a60c-73de8175ac97', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4210ac1-3c9b-4603-a60c-73de8175ac97', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6e0799138a1164dad81da5076324ba27', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c682ed44283d46179bea3d3f238f41e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77735e6d354c3b5b890c0d82194d7557cf205d397ea126fa9b89b2b6a0d86b61423fb21c4840fef91f046932e477dc4cc74a33b3e69fade6a5f09732f110b2d8', 'id': 'e4210ac1-3c9b-4603-a60c-73de8175ac97', 'created_at': datetime.datetime(2026, 8, 5, 8, 34, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 34, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4210ac1-3c9b-4603-a60c-73de8175ac97/file', 'properties': {}}, 'image_service': } Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Trying to clone fba8367c-cd50-48fa-b96d-19d50a5edf72 from image e4210ac1-3c9b-4603-a60c-73de8175ac97 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e4210ac1-3c9b-4603-a60c-73de8175ac97', 'metadata': {}}]). {{(pid=88736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] Creating offline snapshot 28f85a9a-125e-4660-8201-815b92a64c9a of volume dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85de55d-01ba-4d99-ba06-cdf437c2f088]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:34:07 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Image download 0.00 MB at 0.00 MB/s Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[933c2f1d-1e28-4140-8ad4-e11fe77cfde2]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:07 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 Aug 05 10:34:07 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:08 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD Aug 05 10:34:08 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:08 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5" returned: 0 in 0.558s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:08 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a 1G Aug 05 10:34:08 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:08 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:08 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD Aug 05 10:34:08 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:08 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:08 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a 1G" returned: 0 in 0.454s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:34:08 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Temporary image e4210ac1-3c9b-4603-a60c-73de8175ac97 is fetched for user 1efc2271b51b4b7e94a3cfa621986fc9. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:34:08 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a Aug 05 10:34:08 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:08 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8a608d-a8c5-4dc9-82da-dc542fca9a99]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:09 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD Aug 05 10:34:09 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:09 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:09 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a" returned: 0 in 0.618s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:09 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a is being set with open permissions: ugo+rw Aug 05 10:34:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:09 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a Aug 05 10:34:09 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:09 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD Aug 05 10:34:09 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:09 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a" returned: 0 in 0.443s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:09 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD" returned: 1 in 0.555s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:34:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:09 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.info Aug 05 10:34:09 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:10 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.info" returned: 0 in 0.279s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:10 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.info is being set with open permissions: ugo+rw Aug 05 10:34:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:10 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.info Aug 05 10:34:10 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:10 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.info" returned: 0 in 0.259s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.753s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.533s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba8367c-cd50-48fa-b96d-19d50a5edf72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c682ed44283d46179bea3d3f238f41e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:07Z,use_quota=True,user_id='1efc2271b51b4b7e94a3cfa621986fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:34:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Creating volume fba8367c-cd50-48fa-b96d-19d50a5edf72 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:34:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:34:10 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:34:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:10 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72 1073741824 Aug 05 10:34:10 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:10 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7f0e6603-c545-4582-bb2c-803939ab84d6 tempest-SnapshotMetadataTestJSON-201019713 None] Create snapshot completed successfully Aug 05 10:34:10 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72 1073741824" returned: 0 in 0.524s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:11 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72 Aug 05 10:34:11 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:11 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72" returned: 0 in 0.325s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Attempting download of e4210ac1-3c9b-4603-a60c-73de8175ac97 ((None, [{'url': 'file:///opt/stack/data/glance/images/e4210ac1-3c9b-4603-a60c-73de8175ac97', 'metadata': {}}])) to volume fba8367c-cd50-48fa-b96d-19d50a5edf72. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d90ed8-225f-4549-8826-f4ab65b680c0]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4210ac1-3c9b-4603-a60c-73de8175ac97_5k03hym3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] Acquiring lock "cinder-28f85a9a-125e-4660-8201-815b92a64c9a-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] Lock "cinder-28f85a9a-125e-4660-8201-815b92a64c9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] Acquiring lock "cinder-quobyte-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] Lock "cinder-quobyte-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] Acquiring lock "cinder-quobyte-28f85a9a-125e-4660-8201-815b92a64c9a" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] Lock "cinder-quobyte-28f85a9a-125e-4660-8201-815b92a64c9a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] Deleting offline snapshot 28f85a9a-125e-4660-8201-815b92a64c9a of volume dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] snapshot_file for this snap is: volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4be5778-0385-4caf-b2ad-d1e607090c15]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:11 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4210ac1-3c9b-4603-a60c-73de8175ac97_5k03hym3 Aug 05 10:34:11 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:11 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a Aug 05 10:34:11 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:11 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4210ac1-3c9b-4603-a60c-73de8175ac97_5k03hym3" returned: 0 in 0.486s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4210ac1-3c9b-4603-a60c-73de8175ac97_5k03hym3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:12 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4210ac1-3c9b-4603-a60c-73de8175ac97_5k03hym3 Aug 05 10:34:12 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:12 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a" returned: 0 in 0.388s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:34:12 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76b0d92-4550-48e4-ad2b-783cf023d911]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:12 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 Aug 05 10:34:12 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:12 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4210ac1-3c9b-4603-a60c-73de8175ac97_5k03hym3" returned: 1 in 0.338s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4210ac1-3c9b-4603-a60c-73de8175ac97_5k03hym3' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:34:12 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b165a4-e0a0-4d28-81e2-c24295f1b26c]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:12 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD Aug 05 10:34:12 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:12 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5" returned: 0 in 0.441s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:12 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a Aug 05 10:34:12 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:12 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:12 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD Aug 05 10:34:12 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:13 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a" returned: 0 in 0.394s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:13 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a Aug 05 10:34:13 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:13 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] e4210ac1-3c9b-4603-a60c-73de8175ac97 was raw, converting to qcow2 {{(pid=88736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:13 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72 Aug 05 10:34:13 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:13 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5.28f85a9a-125e-4660-8201-815b92a64c9a" returned: 0 in 0.295s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] Lock "cinder-quobyte-28f85a9a-125e-4660-8201-815b92a64c9a" released by "_delete_snapshot" :: held 1.645s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] Lock "cinder-quobyte-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5" released by "delete_snapshot" :: held 1.674s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] Created reservations ['fbd94add-c792-44eb-a9d8-d47def90d16b', '908084dc-5896-4c30-a7ae-cf6e4b11f6db', 'f308bf3b-341b-4062-b87b-6d53a4e47105', '21dbad71-5e62-4d28-991e-1d55b1a4a4c8'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:13 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] Delete snapshot completed successfully. Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-61a6137e-3363-4472-ac44-c4523d76892e tempest-SnapshotMetadataTestJSON-201019713 None] Lock "cinder-28f85a9a-125e-4660-8201-815b92a64c9a-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:13 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72" returned: 0 in 0.512s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e4210ac1-3c9b-4603-a60c-73de8175ac97_1tw_0yoddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72 {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:34:13 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:13 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72 1G Aug 05 10:34:13 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:13 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:34:13 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] Acquiring lock "cinder-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] Lock "cinder-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] Acquiring lock "cinder-quobyte-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] Lock "cinder-quobyte-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5" acquired by "delete_volume" :: waited 0.014s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ea202e-eee8-45da-9f2f-18397f115951]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:14 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72 1G" returned: 0 in 0.416s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Downloaded image e4210ac1-3c9b-4603-a60c-73de8175ac97 ((None, [{'url': 'file:///opt/stack/data/glance/images/e4210ac1-3c9b-4603-a60c-73de8175ac97', 'metadata': {}}])) to volume fba8367c-cd50-48fa-b96d-19d50a5edf72 successfully. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Temporary image e4210ac1-3c9b-4603-a60c-73de8175ac97 for user 1efc2271b51b4b7e94a3cfa621986fc9 is deleted. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Marking volume fba8367c-cd50-48fa-b96d-19d50a5edf72 as bootable. {{(pid=88736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Copying metadata from image e4210ac1-3c9b-4603-a60c-73de8175ac97 to fba8367c-cd50-48fa-b96d-19d50a5edf72. {{(pid=88736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Creating volume glance metadata for volume fba8367c-cd50-48fa-b96d-19d50a5edf72 backed by image e4210ac1-3c9b-4603-a60c-73de8175ac97 with: {'image_id': 'e4210ac1-3c9b-4603-a60c-73de8175ac97', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6e0799138a1164dad81da5076324ba27', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90bf2f7a-bd3d-4f22-9f2d-085905f3629b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba8367c-cd50-48fa-b96d-19d50a5edf72', 'volume_size': 1, 'image_id': 'e4210ac1-3c9b-4603-a60c-73de8175ac97', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4210ac1-3c9b-4603-a60c-73de8175ac97', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6e0799138a1164dad81da5076324ba27', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c682ed44283d46179bea3d3f238f41e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77735e6d354c3b5b890c0d82194d7557cf205d397ea126fa9b89b2b6a0d86b61423fb21c4840fef91f046932e477dc4cc74a33b3e69fade6a5f09732f110b2d8', 'id': 'e4210ac1-3c9b-4603-a60c-73de8175ac97', 'created_at': datetime.datetime(2026, 8, 5, 8, 34, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 34, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4210ac1-3c9b-4603-a60c-73de8175ac97/file', 'properties': {}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:14 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01d1aa4-7648-4b4d-affb-8ed4df8e244a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:14 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:14 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Volume volume-fba8367c-cd50-48fa-b96d-19d50a5edf72 (fba8367c-cd50-48fa-b96d-19d50a5edf72): created successfully Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01d1aa4-7648-4b4d-affb-8ed4df8e244a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Flow 'volume_create_manager' (e771f55a-a89b-44ca-bf70-a4d8e1c4bd0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:14 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-50715ebd-31fb-4b91-9d0a-cfa87fc1b019 tempest-VolumeImageDependencyTests-374240363 None] Created volume successfully. Aug 05 10:34:14 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.417s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:34:14 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5" returned: 0 in 0.398s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:14 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5 Aug 05 10:34:14 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:14 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5" returned: 0 in 0.243s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] Lock "cinder-quobyte-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5" released by "delete_volume" :: held 0.706s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] Acquiring lock "cinder-fba8367c-cd50-48fa-b96d-19d50a5edf72-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] Created reservations ['5617f1f6-eb66-4d31-b75c-1ebf4a2e1923', 'fa040515-addd-48bb-a978-15b07eaf2ff6', 'bf99ba78-bc86-42f5-b5a6-599ba7b2fa12', '90be9f73-3011-4713-96e2-67aea522fe19'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] Lock "cinder-fba8367c-cd50-48fa-b96d-19d50a5edf72-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] Acquiring lock "cinder-quobyte-fba8367c-cd50-48fa-b96d-19d50a5edf72" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] Lock "cinder-quobyte-fba8367c-cd50-48fa-b96d-19d50a5edf72" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbe3288-4494-4fb4-bea2-a10457fea276]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:14 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:34:14 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:15 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72 Aug 05 10:34:15 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:15 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.271s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:15 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:15 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] Deleted volume successfully. Aug 05 10:34:15 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f5e3de72-7848-4acb-9b58-cb59e5912c23 tempest-SnapshotMetadataTestJSON-201019713 None] Lock "cinder-dcb0c99b-c030-4d5c-9e88-4e3a814ca6d5-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:15 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72" returned: 0 in 0.446s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:15 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72 Aug 05 10:34:15 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:15 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fba8367c-cd50-48fa-b96d-19d50a5edf72" returned: 0 in 0.246s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:15 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] Lock "cinder-quobyte-fba8367c-cd50-48fa-b96d-19d50a5edf72" released by "delete_volume" :: held 0.738s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:15 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] Created reservations ['8d4345ef-add0-49fd-a6bd-77bca06b6025', '34562faf-069a-4166-aa5c-1a85a542b1e0', '6f3f2d5f-b31f-42b7-b424-36814e4ced4c', '209defbf-defa-47bd-ad93-8efe29e10478'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:15 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:34:15 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:16 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.290s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:16 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:16 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] Deleted volume successfully. Aug 05 10:34:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a19ff80b-4085-42f0-a9ee-a59886de1b3c tempest-VolumeImageDependencyTests-374240363 None] Lock "cinder-fba8367c-cd50-48fa-b96d-19d50a5edf72-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Flow 'volume_create_manager' (eb2561e1-9754-4917-bd3f-5e6c1988d961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410be502-42b3-44cf-af99-bdb54dcd1a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410be502-42b3-44cf-af99-bdb54dcd1a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0232aa-c067-4eb2-995b-8c6ef0dffc65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='160b1f5ec08c4e359811382f05bc559f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:20Z,use_quota=True,user_id='56f26a12854a4b04a45b3871f10c3628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce59196c-99db-4b43-8138-e68adc1e0b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce59196c-99db-4b43-8138-e68adc1e0b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77c6afc-4094-4207-b9b8-32b936247e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77c6afc-4094-4207-b9b8-32b936247e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae0232aa-c067-4eb2-995b-8c6ef0dffc65', 'volume_name': 'volume-ae0232aa-c067-4eb2-995b-8c6ef0dffc65', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5716ebd0-198a-414e-a2cd-23a1be44fe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5716ebd0-198a-414e-a2cd-23a1be44fe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2746980-08fa-419d-88fb-ea3bf432b45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:19 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Volume ae0232aa-c067-4eb2-995b-8c6ef0dffc65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae0232aa-c067-4eb2-995b-8c6ef0dffc65', 'volume_size': 1} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0232aa-c067-4eb2-995b-8c6ef0dffc65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='160b1f5ec08c4e359811382f05bc559f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:20Z,use_quota=True,user_id='56f26a12854a4b04a45b3871f10c3628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Creating volume ae0232aa-c067-4eb2-995b-8c6ef0dffc65 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:34:19 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:34:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae0232aa-c067-4eb2-995b-8c6ef0dffc65 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:19 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae0232aa-c067-4eb2-995b-8c6ef0dffc65 1073741824 Aug 05 10:34:19 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:20 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae0232aa-c067-4eb2-995b-8c6ef0dffc65 1073741824" returned: 0 in 0.471s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae0232aa-c067-4eb2-995b-8c6ef0dffc65 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:20 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae0232aa-c067-4eb2-995b-8c6ef0dffc65 Aug 05 10:34:20 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:20 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae0232aa-c067-4eb2-995b-8c6ef0dffc65" returned: 0 in 0.274s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:20 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:34:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:20 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2746980-08fa-419d-88fb-ea3bf432b45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae0232aa-c067-4eb2-995b-8c6ef0dffc65', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:20 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54928b2d-6dd4-4657-b79f-d8352ad100a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:20 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Volume volume-ae0232aa-c067-4eb2-995b-8c6ef0dffc65 (ae0232aa-c067-4eb2-995b-8c6ef0dffc65): created successfully Aug 05 10:34:20 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54928b2d-6dd4-4657-b79f-d8352ad100a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:20 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Flow 'volume_create_manager' (eb2561e1-9754-4917-bd3f-5e6c1988d961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:20 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-db7ae3b5-5d02-425d-83b8-23662f3f800a tempest-CinderUnicodeTest-188725549 None] Created volume successfully. Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Flow 'volume_create_manager' (65b69999-b925-4012-b935-a4258df96e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6bbc87-e120-4a36-a3b1-c9bfe06122b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6bbc87-e120-4a36-a3b1-c9bfe06122b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1085167449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb0491f-663a-454b-864c-d2b995215201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='160b1f5ec08c4e359811382f05bc559f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:22Z,use_quota=True,user_id='56f26a12854a4b04a45b3871f10c3628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1b328e-24aa-465e-80b6-dfd40c0d3f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1b328e-24aa-465e-80b6-dfd40c0d3f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92379ff4-6891-44a7-960d-a1593fa4ace0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92379ff4-6891-44a7-960d-a1593fa4ace0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcb0491f-663a-454b-864c-d2b995215201', 'volume_name': 'volume-bcb0491f-663a-454b-864c-d2b995215201', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee344d83-e883-42a0-8378-fd6e02abe01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee344d83-e883-42a0-8378-fd6e02abe01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1b4e50-005a-4121-b1b7-c02965fdc9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:22 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Volume bcb0491f-663a-454b-864c-d2b995215201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcb0491f-663a-454b-864c-d2b995215201', 'volume_size': 1} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1085167449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb0491f-663a-454b-864c-d2b995215201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='160b1f5ec08c4e359811382f05bc559f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:22Z,use_quota=True,user_id='56f26a12854a4b04a45b3871f10c3628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Creating volume bcb0491f-663a-454b-864c-d2b995215201 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:34:22 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:22 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201 1073741824 Aug 05 10:34:22 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Flow 'volume_create_manager' (00dc0d46-01f3-4798-ab9b-3fa4d2887b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2519aafb-a780-45ad-b06b-25e23cbff22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2519aafb-a780-45ad-b06b-25e23cbff22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-118863213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63688b28-5440-4811-8a80-e8f1257df1aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed6cead9c8243f2bc2394e29c88041b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:23Z,use_quota=True,user_id='3b4dc0cd730441aaaabefcbc5df576d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f853fe-9a38-4a10-a492-2d2461d8486b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f853fe-9a38-4a10-a492-2d2461d8486b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:22 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac096708-c575-4e49-a9aa-52f8f90ddcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac096708-c575-4e49-a9aa-52f8f90ddcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63688b28-5440-4811-8a80-e8f1257df1aa', 'volume_name': 'volume-63688b28-5440-4811-8a80-e8f1257df1aa', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a806134-cb9b-469e-8816-bcabf034988b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a806134-cb9b-469e-8816-bcabf034988b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe0db75-661a-4663-bda6-04122ccaf857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:22 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Volume 63688b28-5440-4811-8a80-e8f1257df1aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63688b28-5440-4811-8a80-e8f1257df1aa', 'volume_size': 1} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201 1073741824" returned: 0 in 0.494s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:22 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201 Aug 05 10:34:22 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:23 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201" returned: 0 in 0.245s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.287s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-118863213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63688b28-5440-4811-8a80-e8f1257df1aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed6cead9c8243f2bc2394e29c88041b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:23Z,use_quota=True,user_id='3b4dc0cd730441aaaabefcbc5df576d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Creating volume 63688b28-5440-4811-8a80-e8f1257df1aa {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:34:23 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63688b28-5440-4811-8a80-e8f1257df1aa 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1b4e50-005a-4121-b1b7-c02965fdc9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb0491f-663a-454b-864c-d2b995215201', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec88f21e-d59a-4b2a-b20a-2a07248d7c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:23 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Volume volume-bcb0491f-663a-454b-864c-d2b995215201 (bcb0491f-663a-454b-864c-d2b995215201): created successfully Aug 05 10:34:23 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63688b28-5440-4811-8a80-e8f1257df1aa 1073741824 Aug 05 10:34:23 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec88f21e-d59a-4b2a-b20a-2a07248d7c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Flow 'volume_create_manager' (65b69999-b925-4012-b935-a4258df96e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:23 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-2f72bcb4-5ed6-4001-9f10-46350bfe66a1 tempest-CinderUnicodeTest-188725549 None] Created volume successfully. Aug 05 10:34:23 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63688b28-5440-4811-8a80-e8f1257df1aa 1073741824" returned: 0 in 0.464s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63688b28-5440-4811-8a80-e8f1257df1aa {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:23 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63688b28-5440-4811-8a80-e8f1257df1aa Aug 05 10:34:23 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:23 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63688b28-5440-4811-8a80-e8f1257df1aa" returned: 0 in 0.268s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe0db75-661a-4663-bda6-04122ccaf857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63688b28-5440-4811-8a80-e8f1257df1aa', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86411933-743e-4e42-918e-cd761b7ca134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:23 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Volume volume-63688b28-5440-4811-8a80-e8f1257df1aa (63688b28-5440-4811-8a80-e8f1257df1aa): created successfully Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86411933-743e-4e42-918e-cd761b7ca134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Flow 'volume_create_manager' (00dc0d46-01f3-4798-ab9b-3fa4d2887b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:23 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7d00476f-8235-4570-abd2-22ad353e2cc3 tempest-VolumesTransfersV355Test-170771512 None] Created volume successfully. Aug 05 10:34:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] Creating offline snapshot 3e10da6f-594a-49b5-ae95-62851793fb10 of volume bcb0491f-663a-454b-864c-d2b995215201 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:34:24 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2f5630-b550-4fa1-8712-ff5fe5314719]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:24 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201 Aug 05 10:34:24 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:24 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201" returned: 0 in 0.357s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:24 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10 1G Aug 05 10:34:24 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:25 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10 1G" returned: 0 in 0.403s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcb0491f-663a-454b-864c-d2b995215201 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:25 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcb0491f-663a-454b-864c-d2b995215201 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10 Aug 05 10:34:25 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:25 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-2a55e461-e1c7-4912-be9b-8df3c7288ec2 tempest-VolumesTransfersV355Test-155431249 None] Transfer volume completed successfully. Aug 05 10:34:25 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcb0491f-663a-454b-864c-d2b995215201 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10" returned: 0 in 0.327s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:25 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10 is being set with open permissions: ugo+rw Aug 05 10:34:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:25 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10 Aug 05 10:34:25 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:25 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10" returned: 0 in 0.248s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] Acquiring lock "cinder-63688b28-5440-4811-8a80-e8f1257df1aa-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] Lock "cinder-63688b28-5440-4811-8a80-e8f1257df1aa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:26 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.info Aug 05 10:34:26 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] Acquiring lock "cinder-quobyte-63688b28-5440-4811-8a80-e8f1257df1aa" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] Lock "cinder-quobyte-63688b28-5440-4811-8a80-e8f1257df1aa" acquired by "delete_volume" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb15a787-38f7-4283-b5e4-468fefd0f25c]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63688b28-5440-4811-8a80-e8f1257df1aa {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:26 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63688b28-5440-4811-8a80-e8f1257df1aa Aug 05 10:34:26 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:26 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.info" returned: 0 in 0.251s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:26 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.info is being set with open permissions: ugo+rw Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:26 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.info Aug 05 10:34:26 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:26 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63688b28-5440-4811-8a80-e8f1257df1aa" returned: 0 in 0.361s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63688b28-5440-4811-8a80-e8f1257df1aa {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:26 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63688b28-5440-4811-8a80-e8f1257df1aa Aug 05 10:34:26 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:26 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.info" returned: 0 in 0.247s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.948s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:26 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-6cbd749f-6159-4519-bb39-a569c46d5259 tempest-CinderUnicodeTest-188725549 None] Create snapshot completed successfully Aug 05 10:34:26 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63688b28-5440-4811-8a80-e8f1257df1aa" returned: 0 in 0.261s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] Lock "cinder-quobyte-63688b28-5440-4811-8a80-e8f1257df1aa" released by "delete_volume" :: held 0.661s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] Acquiring lock "cinder-3e10da6f-594a-49b5-ae95-62851793fb10-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] Lock "cinder-3e10da6f-594a-49b5-ae95-62851793fb10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] Acquiring lock "cinder-quobyte-bcb0491f-663a-454b-864c-d2b995215201" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] Lock "cinder-quobyte-bcb0491f-663a-454b-864c-d2b995215201" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] Acquiring lock "cinder-quobyte-3e10da6f-594a-49b5-ae95-62851793fb10" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] Created reservations ['61ade96e-b0e8-45a5-8aa6-4b7523899b15', '7a78406f-0c17-4b4f-a8e0-818d6cdfdf03', '205295f9-ece2-4484-8d11-4170f14a3f3f', '461982ee-f1fa-4201-8161-826880daf6ca'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] Lock "cinder-quobyte-3e10da6f-594a-49b5-ae95-62851793fb10" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] Deleting offline snapshot 3e10da6f-594a-49b5-ae95-62851793fb10 of volume bcb0491f-663a-454b-864c-d2b995215201 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] snapshot_file for this snap is: volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[de611b4b-352a-4e00-b154-b73738349a52]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:26 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:34:26 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:26 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10 Aug 05 10:34:26 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:27 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.247s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:27 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] Deleted volume successfully. Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e7894f7d-c30b-4a07-9f75-5b1b3313c384 tempest-VolumesTransfersV355Test-429824274 None] Lock "cinder-63688b28-5440-4811-8a80-e8f1257df1aa-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:27 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10" returned: 0 in 0.376s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcb0491f-663a-454b-864c-d2b995215201(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2eb514b-4a83-4c9e-90d2-63e3acbce44b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:27 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201 Aug 05 10:34:27 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:27 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201" returned: 0 in 0.375s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:27 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10 Aug 05 10:34:27 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Flow 'volume_create_manager' (9d169c93-ec9c-4d7f-97b6-95caf5ae601d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b407336-1b09-4692-b5d9-dba6884f8093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b407336-1b09-4692-b5d9-dba6884f8093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1214892251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b8af82-c23e-4ca1-946e-7abf9a57305c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed6cead9c8243f2bc2394e29c88041b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:28Z,use_quota=True,user_id='3b4dc0cd730441aaaabefcbc5df576d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24a4c0f-4bac-40f8-9ffb-8a0533b454bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24a4c0f-4bac-40f8-9ffb-8a0533b454bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec995b32-9972-43f9-aef0-92f5a2ed93cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec995b32-9972-43f9-aef0-92f5a2ed93cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7b8af82-c23e-4ca1-946e-7abf9a57305c', 'volume_name': 'volume-f7b8af82-c23e-4ca1-946e-7abf9a57305c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd0ea8a-40c4-40fb-b7ed-349baa110b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd0ea8a-40c4-40fb-b7ed-349baa110b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05e089c-8863-446e-a6f2-8f04a1510b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:27 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Volume f7b8af82-c23e-4ca1-946e-7abf9a57305c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7b8af82-c23e-4ca1-946e-7abf9a57305c', 'volume_size': 1} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1214892251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b8af82-c23e-4ca1-946e-7abf9a57305c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed6cead9c8243f2bc2394e29c88041b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:28Z,use_quota=True,user_id='3b4dc0cd730441aaaabefcbc5df576d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Creating volume f7b8af82-c23e-4ca1-946e-7abf9a57305c {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:34:27 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f7b8af82-c23e-4ca1-946e-7abf9a57305c 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:27 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f7b8af82-c23e-4ca1-946e-7abf9a57305c 1073741824 Aug 05 10:34:27 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:27 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10" returned: 0 in 0.313s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:27 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10 Aug 05 10:34:27 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:28 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f7b8af82-c23e-4ca1-946e-7abf9a57305c 1073741824" returned: 0 in 0.414s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:28 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201.3e10da6f-594a-49b5-ae95-62851793fb10" returned: 0 in 0.242s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f7b8af82-c23e-4ca1-946e-7abf9a57305c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] Lock "cinder-quobyte-3e10da6f-594a-49b5-ae95-62851793fb10" released by "_delete_snapshot" :: held 1.417s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] Lock "cinder-quobyte-bcb0491f-663a-454b-864c-d2b995215201" released by "delete_snapshot" :: held 1.453s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:28 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f7b8af82-c23e-4ca1-946e-7abf9a57305c Aug 05 10:34:28 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] Created reservations ['615eaa57-a44e-4752-b420-c59add79593a', 'ad391e70-ec52-4898-a954-0360933a0e74', 'e5881bf9-220e-435c-b711-7fae99198da5', '2d581828-58d2-4757-a367-33bdf5b02066'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:28 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] Delete snapshot completed successfully. Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ecd1b5a3-17e4-405b-ac49-c9728f6f0367 tempest-CinderUnicodeTest-188725549 None] Lock "cinder-3e10da6f-594a-49b5-ae95-62851793fb10-delete_snapshot" released by "delete_snapshot" :: held 1.616s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:28 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f7b8af82-c23e-4ca1-946e-7abf9a57305c" returned: 0 in 0.264s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05e089c-8863-446e-a6f2-8f04a1510b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b8af82-c23e-4ca1-946e-7abf9a57305c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f4b53da-fe36-422c-910f-77ef107510dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:28 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Volume volume-f7b8af82-c23e-4ca1-946e-7abf9a57305c (f7b8af82-c23e-4ca1-946e-7abf9a57305c): created successfully Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f4b53da-fe36-422c-910f-77ef107510dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Flow 'volume_create_manager' (9d169c93-ec9c-4d7f-97b6-95caf5ae601d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:28 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c608f189-b91a-4994-9d1f-164ec9c2ebe6 tempest-VolumesTransfersV355Test-170771512 None] Created volume successfully. Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] Acquiring lock "cinder-bcb0491f-663a-454b-864c-d2b995215201-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] Lock "cinder-bcb0491f-663a-454b-864c-d2b995215201-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] Acquiring lock "cinder-f7b8af82-c23e-4ca1-946e-7abf9a57305c-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] Acquiring lock "cinder-quobyte-bcb0491f-663a-454b-864c-d2b995215201" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] Lock "cinder-f7b8af82-c23e-4ca1-946e-7abf9a57305c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] Lock "cinder-quobyte-bcb0491f-663a-454b-864c-d2b995215201" acquired by "delete_volume" :: waited 0.027s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb7b265-9cfe-42a9-a8f6-8011bccb05f4]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] Acquiring lock "cinder-quobyte-f7b8af82-c23e-4ca1-946e-7abf9a57305c" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] Lock "cinder-quobyte-f7b8af82-c23e-4ca1-946e-7abf9a57305c" acquired by "delete_volume" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab5324d-b89f-4e29-8ace-8fbc3cda3688]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f7b8af82-c23e-4ca1-946e-7abf9a57305c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:29 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201 Aug 05 10:34:29 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:29 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f7b8af82-c23e-4ca1-946e-7abf9a57305c Aug 05 10:34:29 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:29 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201" returned: 0 in 0.357s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:29 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201 Aug 05 10:34:29 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:29 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f7b8af82-c23e-4ca1-946e-7abf9a57305c" returned: 0 in 0.356s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f7b8af82-c23e-4ca1-946e-7abf9a57305c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:29 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f7b8af82-c23e-4ca1-946e-7abf9a57305c Aug 05 10:34:29 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:29 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bcb0491f-663a-454b-864c-d2b995215201" returned: 0 in 0.243s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] Lock "cinder-quobyte-bcb0491f-663a-454b-864c-d2b995215201" released by "delete_volume" :: held 0.664s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:29 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f7b8af82-c23e-4ca1-946e-7abf9a57305c" returned: 0 in 0.238s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] Lock "cinder-quobyte-f7b8af82-c23e-4ca1-946e-7abf9a57305c" released by "delete_volume" :: held 0.632s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] Created reservations ['de312c48-b995-4096-825d-51ad563354e7', 'd15fc2f4-9abe-4915-9e30-2205d3e7c26b', 'cd571b6c-4a32-4b1e-86a6-99ab7ec338d7', 'e58d5654-b780-4196-8c35-42fc22953f97'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] Created reservations ['c323569f-3bfa-4aab-81a8-8d8a1ab26b9b', '8d06ae9e-f853-4d16-aa3e-f3dee9653f43', 'c6343e71-774a-4c7a-be0f-703532976f74', '14f560bb-192e-4fc4-aeb0-3e40489501cf'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:29 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:34:29 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:29 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:34:29 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:30 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.251s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:30 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] Deleted volume successfully. Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-64f3d8dd-2924-42a4-8a51-44ae5060e166 tempest-CinderUnicodeTest-188725549 None] Lock "cinder-bcb0491f-663a-454b-864c-d2b995215201-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] Acquiring lock "cinder-ae0232aa-c067-4eb2-995b-8c6ef0dffc65-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] Lock "cinder-ae0232aa-c067-4eb2-995b-8c6ef0dffc65-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:30 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.292s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:30 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] Deleted volume successfully. Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] Acquiring lock "cinder-quobyte-ae0232aa-c067-4eb2-995b-8c6ef0dffc65" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-69cea994-1723-4dd4-a4ce-7cf588db8122 tempest-VolumesTransfersV355Test-429824274 None] Lock "cinder-f7b8af82-c23e-4ca1-946e-7abf9a57305c-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] Lock "cinder-quobyte-ae0232aa-c067-4eb2-995b-8c6ef0dffc65" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[506cd697-6f16-42c0-9337-6e00ad7dc3ce]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae0232aa-c067-4eb2-995b-8c6ef0dffc65 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:30 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae0232aa-c067-4eb2-995b-8c6ef0dffc65 Aug 05 10:34:30 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:30 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae0232aa-c067-4eb2-995b-8c6ef0dffc65" returned: 0 in 0.371s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae0232aa-c067-4eb2-995b-8c6ef0dffc65 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:30 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae0232aa-c067-4eb2-995b-8c6ef0dffc65 Aug 05 10:34:30 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:30 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae0232aa-c067-4eb2-995b-8c6ef0dffc65" returned: 0 in 0.246s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] Lock "cinder-quobyte-ae0232aa-c067-4eb2-995b-8c6ef0dffc65" released by "delete_volume" :: held 0.666s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] Created reservations ['ad31e359-a09d-479d-846a-b8182e509558', '6902fb60-83c5-4f23-81df-44234f24d8d7', '00e88f1d-c4ea-4218-9072-ced56044313b', 'd31b0ea3-6048-439c-b257-d7c2c4c0ebc0'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:30 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:34:30 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:31 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.274s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:31 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:34:31 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] Deleted volume successfully. Aug 05 10:34:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-09bd6101-b9d7-49eb-8c70-16691b38bb9f tempest-CinderUnicodeTest-188725549 None] Lock "cinder-ae0232aa-c067-4eb2-995b-8c6ef0dffc65-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:34:33 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-68f46980-4422-4230-b0b5-9e5fc3c3f062 req-c9b8d703-2a70-4ac4-90a4-823bb8c591b6 tempest-AttachVolumeTestJSON-1541903996 None] Terminate volume connection completed successfully. Aug 05 10:34:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-68f46980-4422-4230-b0b5-9e5fc3c3f062 req-c9b8d703-2a70-4ac4-90a4-823bb8c591b6 tempest-AttachVolumeTestJSON-1541903996 None] Deleting attachment 4c2b0b07-3430-4cdb-86ab-61e1be367384. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:34:41 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:UPDATE=162,cinder:SELECT=107,cinder:INSERT=46,cinder:DELETE=14 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:34:43 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=150,cinder:UPDATE=157,cinder:INSERT=39,cinder:DELETE=14 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Flow 'volume_create_manager' (737f3c91-b9a7-45b0-8800-d4ddab2adc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41780bc6-890e-4459-8450-b2ad84e6c6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41780bc6-890e-4459-8450-b2ad84e6c6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-235857044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114e6943-858f-464a-be9c-cb003701f59c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8dc6d0fb6146f2824e0c8529623ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:48Z,use_quota=True,user_id='342145eed9d541dc8dba1afabc8fd52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f455cde5-d4e5-4c07-96cf-01b49578c9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f455cde5-d4e5-4c07-96cf-01b49578c9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0efd018-580e-4fe7-a76e-bd525fb80e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0efd018-580e-4fe7-a76e-bd525fb80e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114e6943-858f-464a-be9c-cb003701f59c', 'volume_name': 'volume-114e6943-858f-464a-be9c-cb003701f59c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3909207a-91b8-4eae-9604-68a8505ca6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3909207a-91b8-4eae-9604-68a8505ca6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560b2dc8-04de-4439-98fd-771610ada98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:47 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Volume 114e6943-858f-464a-be9c-cb003701f59c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114e6943-858f-464a-be9c-cb003701f59c', 'volume_size': 1} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-235857044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114e6943-858f-464a-be9c-cb003701f59c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8dc6d0fb6146f2824e0c8529623ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:34:48Z,use_quota=True,user_id='342145eed9d541dc8dba1afabc8fd52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Creating volume 114e6943-858f-464a-be9c-cb003701f59c {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:34:47 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:34:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:47 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c 1073741824 Aug 05 10:34:47 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:48 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c 1073741824" returned: 0 in 0.472s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:34:48 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c Aug 05 10:34:48 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:34:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c" returned: 0 in 0.495s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:34:48 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Aug 05 10:34:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:34:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:34:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560b2dc8-04de-4439-98fd-771610ada98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114e6943-858f-464a-be9c-cb003701f59c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882205b5-d79e-4cf6-84cb-84e3603af4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:34:49 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Volume volume-114e6943-858f-464a-be9c-cb003701f59c (114e6943-858f-464a-be9c-cb003701f59c): created successfully Aug 05 10:34:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882205b5-d79e-4cf6-84cb-84e3603af4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:34:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Flow 'volume_create_manager' (737f3c91-b9a7-45b0-8800-d4ddab2adc15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:34:49 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-79d0ecd2-37b3-42c5-896c-7d4aed9e25b7 tempest-VolumesActionsTest-73769324 None] Created volume successfully. Aug 05 10:34:58 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:34:59 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:35:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d7e8c088-a1ac-4bc7-ae27-58e4c8343636 tempest-VolumesActionsTest-73769324 None] Acquiring lock "cinder-114e6943-858f-464a-be9c-cb003701f59c" by "attach_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d7e8c088-a1ac-4bc7-ae27-58e4c8343636 tempest-VolumesActionsTest-73769324 None] Lock "cinder-114e6943-858f-464a-be9c-cb003701f59c" acquired by "attach_volume" :: waited 0.051s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:01 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d7e8c088-a1ac-4bc7-ae27-58e4c8343636 tempest-VolumesActionsTest-73769324 None] Attaching volume 114e6943-858f-464a-be9c-cb003701f59c to instance 73de6944-89db-4fc2-be9e-16cec1981d18 at mountpoint /dev/vdb on host None. Aug 05 10:35:01 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d7e8c088-a1ac-4bc7-ae27-58e4c8343636 tempest-VolumesActionsTest-73769324 None] Attach volume completed successfully. Aug 05 10:35:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d7e8c088-a1ac-4bc7-ae27-58e4c8343636 tempest-VolumesActionsTest-73769324 None] Lock "cinder-114e6943-858f-464a-be9c-cb003701f59c" released by "attach_volume" :: held 0.203s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-df68f727-9ff6-4655-a102-fcb5855b82a1 tempest-VolumesActionsTest-73769324 None] Acquiring lock "cinder-114e6943-858f-464a-be9c-cb003701f59c-detach_volume" by "detach_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-df68f727-9ff6-4655-a102-fcb5855b82a1 tempest-VolumesActionsTest-73769324 None] Lock "cinder-114e6943-858f-464a-be9c-cb003701f59c-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:02 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-df68f727-9ff6-4655-a102-fcb5855b82a1 tempest-VolumesActionsTest-73769324 None] Detaching volume 114e6943-858f-464a-be9c-cb003701f59c from instance 73de6944-89db-4fc2-be9e-16cec1981d18. Aug 05 10:35:02 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-df68f727-9ff6-4655-a102-fcb5855b82a1 tempest-VolumesActionsTest-73769324 None] Detach volume completed successfully. Aug 05 10:35:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-df68f727-9ff6-4655-a102-fcb5855b82a1 tempest-VolumesActionsTest-73769324 None] Lock "cinder-114e6943-858f-464a-be9c-cb003701f59c-detach_volume" released by "detach_volume" :: held 0.150s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Flow 'volume_create_manager' (269ffd5b-479b-4fb3-bfdc-95b58e6e31d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14864be0-93f6-44f2-b73c-286c63470893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14864be0-93f6-44f2-b73c-286c63470893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-321173573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e243b53-26c8-482b-9a20-480f10f5c93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='061d6b99ac39442797a0a618376a5638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:35:07Z,use_quota=True,user_id='664a6625c2fb46bcacbc08da03baf089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf4eb9d-23d0-4bce-a54e-98eced0bbca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf4eb9d-23d0-4bce-a54e-98eced0bbca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc8142a-a21c-404a-b23c-1686cd0196a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc8142a-a21c-404a-b23c-1686cd0196a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e243b53-26c8-482b-9a20-480f10f5c93c', 'volume_name': 'volume-1e243b53-26c8-482b-9a20-480f10f5c93c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbfdd654-a22c-45e6-b54c-34175b31cc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbfdd654-a22c-45e6-b54c-34175b31cc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a565193-1c77-4995-a82f-69e64e3776c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:06 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Volume 1e243b53-26c8-482b-9a20-480f10f5c93c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e243b53-26c8-482b-9a20-480f10f5c93c', 'volume_size': 1} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-321173573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e243b53-26c8-482b-9a20-480f10f5c93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='061d6b99ac39442797a0a618376a5638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:35:07Z,use_quota=True,user_id='664a6625c2fb46bcacbc08da03baf089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Creating volume 1e243b53-26c8-482b-9a20-480f10f5c93c {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:35:06 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:35:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:06 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c 1073741824 Aug 05 10:35:06 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:07 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c 1073741824" returned: 0 in 0.633s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:07 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c Aug 05 10:35:07 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:07 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c" returned: 0 in 0.378s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:35:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:35:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a565193-1c77-4995-a82f-69e64e3776c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e243b53-26c8-482b-9a20-480f10f5c93c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee5361a-a093-42fe-b15b-96885c1e0d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:07 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Volume volume-1e243b53-26c8-482b-9a20-480f10f5c93c (1e243b53-26c8-482b-9a20-480f10f5c93c): created successfully Aug 05 10:35:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee5361a-a093-42fe-b15b-96885c1e0d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Flow 'volume_create_manager' (269ffd5b-479b-4fb3-bfdc-95b58e6e31d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:35:08 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-4edc1c20-b792-4dcc-afef-4b25348affab tempest-SnapshotDependencyTests-1002724430 None] Created volume successfully. Aug 05 10:35:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:35:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:35:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] Creating offline snapshot 230f0557-5ec3-4e42-8a6b-3622290e005e of volume 1e243b53-26c8-482b-9a20-480f10f5c93c {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:35:09 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2579d6fb-c3bc-408c-89df-6b9440ff3ecb]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:35:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:09 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c Aug 05 10:35:09 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:09 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c" returned: 0 in 0.550s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:09 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e 1G Aug 05 10:35:09 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:10 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e 1G" returned: 0 in 0.566s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e243b53-26c8-482b-9a20-480f10f5c93c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:10 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e243b53-26c8-482b-9a20-480f10f5c93c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e Aug 05 10:35:10 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:10 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e243b53-26c8-482b-9a20-480f10f5c93c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e" returned: 0 in 0.306s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:10 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e is being set with open permissions: ugo+rw Aug 05 10:35:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:10 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e Aug 05 10:35:10 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:10 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e" returned: 0 in 0.253s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:10 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.info Aug 05 10:35:10 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:11 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.info" returned: 0 in 0.281s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:11 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.info is being set with open permissions: ugo+rw Aug 05 10:35:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:11 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.info Aug 05 10:35:11 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:11 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.info" returned: 0 in 0.278s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.362s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:35:11 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-0710a13e-3f05-4be3-80bc-74c8f6f4b375 tempest-SnapshotDependencyTests-1002724430 None] Create snapshot completed successfully Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Flow 'volume_create_manager' (99c0df6c-b0d3-43d2-8642-8173d0ac00b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efee4e6-03f2-4a01-8800-5eaf1a3a76f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efee4e6-03f2-4a01-8800-5eaf1a3a76f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a359860-7616-4993-88ef-93c47380b6e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='061d6b99ac39442797a0a618376a5638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=230f0557-5ec3-4e42-8a6b-3622290e005e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:35:13Z,use_quota=True,user_id='664a6625c2fb46bcacbc08da03baf089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ea97ac-edec-41cb-ae3b-39297cd4a81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ea97ac-edec-41cb-ae3b-39297cd4a81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abd8bec-b1e5-41e8-9645-8cf22fb6d568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abd8bec-b1e5-41e8-9645-8cf22fb6d568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2a359860-7616-4993-88ef-93c47380b6e3', 'volume_name': 'volume-2a359860-7616-4993-88ef-93c47380b6e3', 'volume_size': 1, 'snapshot_id': '230f0557-5ec3-4e42-8a6b-3622290e005e'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6cace7-4443-4459-b7fc-333ddc7dae2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6cace7-4443-4459-b7fc-333ddc7dae2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa7f3a7-338f-496d-8dc9-282d7c7f68ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:13 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Volume 2a359860-7616-4993-88ef-93c47380b6e3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2a359860-7616-4993-88ef-93c47380b6e3', 'volume_size': 1, 'snapshot_id': '230f0557-5ec3-4e42-8a6b-3622290e005e'} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Acquiring lock "cinder-quobyte-230f0557-5ec3-4e42-8a6b-3622290e005e-2a359860-7616-4993-88ef-93c47380b6e3" by "_create_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-quobyte-230f0557-5ec3-4e42-8a6b-3622290e005e-2a359860-7616-4993-88ef-93c47380b6e3" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Creating volume 2a359860-7616-4993-88ef-93c47380b6e3 from snapshot 230f0557-5ec3-4e42-8a6b-3622290e005e {{(pid=88736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Acquiring lock "cinder-quobyte-2a359860-7616-4993-88ef-93c47380b6e3" by "_copy_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-quobyte-2a359860-7616-4993-88ef-93c47380b6e3" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] snapshot: 230f0557-5ec3-4e42-8a6b-3622290e005e, volume: 2a359860-7616-4993-88ef-93c47380b6e3, {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d77d0f-9387-4a50-a90b-cc63139e29a5]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:35:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:13 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:35:13 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:14 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e Aug 05 10:35:14 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:14 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.274s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:35:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:35:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:35:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:35:14 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e" returned: 0 in 0.521s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e243b53-26c8-482b-9a20-480f10f5c93c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:35:14 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d740a1-0b5e-4e94-9b7a-327b8263053f]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:35:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:14 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c Aug 05 10:35:14 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:15 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c" returned: 0 in 0.626s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] will copy from snapshot at /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:35:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Creating direct copy from snapshot {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:35:15 devstack cinder-volume[88736]: DEBUG cinder.utils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Path /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a359860-7616-4993-88ef-93c47380b6e3 not found in is_blk_device check {{(pid=88736) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:35:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a359860-7616-4993-88ef-93c47380b6e3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:15 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a359860-7616-4993-88ef-93c47380b6e3 Aug 05 10:35:15 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-86821839-3f9a-4e1e-b124-02fff8b4a5ca tempest-VolumesActionsTest-73769324 None] Acquiring lock "cinder-114e6943-858f-464a-be9c-cb003701f59c" by "attach_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-86821839-3f9a-4e1e-b124-02fff8b4a5ca tempest-VolumesActionsTest-73769324 None] Lock "cinder-114e6943-858f-464a-be9c-cb003701f59c" acquired by "attach_volume" :: waited 0.071s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:17 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-86821839-3f9a-4e1e-b124-02fff8b4a5ca tempest-VolumesActionsTest-73769324 None] Attaching volume 114e6943-858f-464a-be9c-cb003701f59c to instance 78b34276-7270-4d0b-a40e-32f384524364 at mountpoint /dev/vdb on host None. Aug 05 10:35:17 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-86821839-3f9a-4e1e-b124-02fff8b4a5ca tempest-VolumesActionsTest-73769324 None] Attach volume completed successfully. Aug 05 10:35:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-86821839-3f9a-4e1e-b124-02fff8b4a5ca tempest-VolumesActionsTest-73769324 None] Lock "cinder-114e6943-858f-464a-be9c-cb003701f59c" released by "attach_volume" :: held 0.287s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1b9b2cb6-a718-4fda-975b-0fa0526c61df tempest-VolumesActionsTest-73769324 None] Acquiring lock "cinder-114e6943-858f-464a-be9c-cb003701f59c-detach_volume" by "detach_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1b9b2cb6-a718-4fda-975b-0fa0526c61df tempest-VolumesActionsTest-73769324 None] Lock "cinder-114e6943-858f-464a-be9c-cb003701f59c-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:18 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1b9b2cb6-a718-4fda-975b-0fa0526c61df tempest-VolumesActionsTest-73769324 None] Detaching volume 114e6943-858f-464a-be9c-cb003701f59c from instance 78b34276-7270-4d0b-a40e-32f384524364. Aug 05 10:35:18 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1b9b2cb6-a718-4fda-975b-0fa0526c61df tempest-VolumesActionsTest-73769324 None] Detach volume completed successfully. Aug 05 10:35:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1b9b2cb6-a718-4fda-975b-0fa0526c61df tempest-VolumesActionsTest-73769324 None] Lock "cinder-114e6943-858f-464a-be9c-cb003701f59c-detach_volume" released by "detach_volume" :: held 0.225s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:22 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a359860-7616-4993-88ef-93c47380b6e3" returned: 0 in 6.979s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:22 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Image conversion details: src /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c, size 1024.00 MB, duration 6.98 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a359860-7616-4993-88ef-93c47380b6e3 {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:35:22 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Converted 1024.00 MB image at 146.71 MB/s Aug 05 10:35:22 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a359860-7616-4993-88ef-93c47380b6e3 is being set with open permissions: ugo+rw Aug 05 10:35:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a359860-7616-4993-88ef-93c47380b6e3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:22 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a359860-7616-4993-88ef-93c47380b6e3 Aug 05 10:35:22 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:22 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a359860-7616-4993-88ef-93c47380b6e3" returned: 0 in 0.389s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-quobyte-2a359860-7616-4993-88ef-93c47380b6e3" released by "_copy_volume_from_snapshot" :: held 8.655s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-quobyte-230f0557-5ec3-4e42-8a6b-3622290e005e-2a359860-7616-4993-88ef-93c47380b6e3" released by "_create_volume_from_snapshot" :: held 8.760s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.784s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:35:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa7f3a7-338f-496d-8dc9-282d7c7f68ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a359860-7616-4993-88ef-93c47380b6e3', 'volume_size': 1, 'snapshot_id': '230f0557-5ec3-4e42-8a6b-3622290e005e'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7bdbe2-431c-4b8a-8a1f-a2fca0dcb128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:22 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Volume volume-2a359860-7616-4993-88ef-93c47380b6e3 (2a359860-7616-4993-88ef-93c47380b6e3): created successfully Aug 05 10:35:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7bdbe2-431c-4b8a-8a1f-a2fca0dcb128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Flow 'volume_create_manager' (99c0df6c-b0d3-43d2-8642-8173d0ac00b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:35:22 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8d82a930-2c49-46ea-98b5-efde281172d1 tempest-SnapshotDependencyTests-1002724430 None] Created volume successfully. Aug 05 10:35:23 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] Acquiring lock "cinder-230f0557-5ec3-4e42-8a6b-3622290e005e-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:23 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-230f0557-5ec3-4e42-8a6b-3622290e005e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:23 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] Acquiring lock "cinder-quobyte-1e243b53-26c8-482b-9a20-480f10f5c93c" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:23 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-quobyte-1e243b53-26c8-482b-9a20-480f10f5c93c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:23 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] Acquiring lock "cinder-quobyte-230f0557-5ec3-4e42-8a6b-3622290e005e" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:23 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-quobyte-230f0557-5ec3-4e42-8a6b-3622290e005e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] Deleting offline snapshot 230f0557-5ec3-4e42-8a6b-3622290e005e of volume 1e243b53-26c8-482b-9a20-480f10f5c93c {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:35:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] snapshot_file for this snap is: volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:35:23 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48d3a32-53d0-4089-a108-e343133d5827]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:35:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:24 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e Aug 05 10:35:24 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:24 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e" returned: 0 in 0.422s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e243b53-26c8-482b-9a20-480f10f5c93c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:35:24 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa1c7a8-f495-44c4-b058-679e3a7427cd]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:35:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:24 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c Aug 05 10:35:24 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:25 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c" returned: 0 in 0.832s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:25 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e Aug 05 10:35:25 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-11fd2e28-097f-46c4-bfb0-071ecf17e25f tempest-VolumesActionsTest-73769324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:35:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-11fd2e28-097f-46c4-bfb0-071ecf17e25f tempest-VolumesActionsTest-73769324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:35:25 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[791764de-8a01-443a-a1c4-0deda2b20d7c]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:35:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-11fd2e28-097f-46c4-bfb0-071ecf17e25f tempest-VolumesActionsTest-73769324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:25 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c Aug 05 10:35:25 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:25 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e" returned: 0 in 0.680s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:25 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e Aug 05 10:35:26 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:26 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-11fd2e28-097f-46c4-bfb0-071ecf17e25f tempest-VolumesActionsTest-73769324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c" returned: 0 in 0.503s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:26 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[469fa019-a3a1-4ba6-a175-f276fdc1c8ca]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:35:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-11fd2e28-097f-46c4-bfb0-071ecf17e25f tempest-VolumesActionsTest-73769324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:26 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c.230f0557-5ec3-4e42-8a6b-3622290e005e" returned: 0 in 0.320s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:26 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c Aug 05 10:35:26 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-quobyte-230f0557-5ec3-4e42-8a6b-3622290e005e" released by "_delete_snapshot" :: held 2.384s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-quobyte-1e243b53-26c8-482b-9a20-480f10f5c93c" released by "delete_snapshot" :: held 2.416s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:26 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] Created reservations ['6a40109f-9077-4b4b-a408-63d484bcec3d', 'a3419894-fc68-4750-acf3-cf117c24c541', 'afc83dc6-7bb5-44fe-97c1-042264d98c41', '1645c870-5c2f-49b2-8433-82cf0992003a'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:35:26 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] Delete snapshot completed successfully. Aug 05 10:35:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d27ae51d-b575-4c04-afdd-d7887efdfaea tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-230f0557-5ec3-4e42-8a6b-3622290e005e-delete_snapshot" released by "delete_snapshot" :: held 2.628s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:26 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-11fd2e28-097f-46c4-bfb0-071ecf17e25f tempest-VolumesActionsTest-73769324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c" returned: 0 in 0.495s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-11fd2e28-097f-46c4-bfb0-071ecf17e25f tempest-VolumesActionsTest-73769324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.bf93cb37-0225-48b4-91ba-379aba0af6420h4__o8d.img {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:26 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.bf93cb37-0225-48b4-91ba-379aba0af6420h4__o8d.img Aug 05 10:35:26 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] Acquiring lock "cinder-1e243b53-26c8-482b-9a20-480f10f5c93c-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-1e243b53-26c8-482b-9a20-480f10f5c93c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] Acquiring lock "cinder-quobyte-1e243b53-26c8-482b-9a20-480f10f5c93c" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-quobyte-1e243b53-26c8-482b-9a20-480f10f5c93c" acquired by "delete_volume" :: waited 0.069s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:27 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5139c0-30ae-45a8-8a73-62759d10c6c7]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:35:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:28 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c Aug 05 10:35:28 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:29 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c" returned: 0 in 1.754s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:29 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c Aug 05 10:35:29 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:30 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1e243b53-26c8-482b-9a20-480f10f5c93c" returned: 0 in 0.586s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-quobyte-1e243b53-26c8-482b-9a20-480f10f5c93c" released by "delete_volume" :: held 2.568s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:30 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] Created reservations ['6b3d27b3-8764-4f78-b41c-ebb84a1548f1', 'aaf71acb-46cf-4ddd-88ae-26c079b0bbef', 'b944b359-e49b-443e-928f-ca44d462cc06', '67b31b1d-dea1-45a2-a492-68cd939faed0'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:35:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:35:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:35:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:35:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:35:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:35:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:30 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:35:30 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:31 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] Acquiring lock "cinder-2a359860-7616-4993-88ef-93c47380b6e3-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.839s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:31 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:35:31 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] Deleted volume successfully. Aug 05 10:35:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-2a359860-7616-4993-88ef-93c47380b6e3-delete_volume" acquired by "delete_volume" :: waited 0.151s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-57f96bc4-1f73-4433-9ff2-bf8c697b2848 tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-1e243b53-26c8-482b-9a20-480f10f5c93c-delete_volume" released by "delete_volume" :: held 4.292s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] Acquiring lock "cinder-quobyte-2a359860-7616-4993-88ef-93c47380b6e3" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:35:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-quobyte-2a359860-7616-4993-88ef-93c47380b6e3" acquired by "delete_volume" :: waited 0.036s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:35:31 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df67542-7efc-4b06-afc9-ee5315d90645]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:35:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a359860-7616-4993-88ef-93c47380b6e3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:32 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a359860-7616-4993-88ef-93c47380b6e3 Aug 05 10:35:32 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:33 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a359860-7616-4993-88ef-93c47380b6e3" returned: 0 in 1.333s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a359860-7616-4993-88ef-93c47380b6e3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:33 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a359860-7616-4993-88ef-93c47380b6e3 Aug 05 10:35:33 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:33 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-11fd2e28-097f-46c4-bfb0-071ecf17e25f tempest-VolumesActionsTest-73769324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.bf93cb37-0225-48b4-91ba-379aba0af6420h4__o8d.img" returned: 0 in 6.650s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:33 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4323c5-471b-4f91-a521-b6ae22d5d147]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:35:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-11fd2e28-097f-46c4-bfb0-071ecf17e25f tempest-VolumesActionsTest-73769324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:33 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c Aug 05 10:35:33 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:33 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a359860-7616-4993-88ef-93c47380b6e3" returned: 0 in 0.312s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-quobyte-2a359860-7616-4993-88ef-93c47380b6e3" released by "delete_volume" :: held 1.769s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:33 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] Created reservations ['dd64affe-d5da-46d7-b66f-4e0a56d1a724', '6c003ada-7749-4527-bd5d-0c4fa1d3ec6f', 'f7e03bd9-9c2b-45cd-9b2b-8e17116b787b', 'e3f523f2-4fbc-42a1-a12a-6d1597da045a'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:35:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:35:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:35:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:35:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:35:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:35:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:33 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:35:33 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:34 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-11fd2e28-097f-46c4-bfb0-071ecf17e25f tempest-VolumesActionsTest-73769324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c" returned: 0 in 0.850s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:34 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-11fd2e28-097f-46c4-bfb0-071ecf17e25f tempest-VolumesActionsTest-73769324 None] Image conversion details: src /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.bf93cb37-0225-48b4-91ba-379aba0af6420h4__o8d.img {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:35:34 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-11fd2e28-097f-46c4-bfb0-071ecf17e25f tempest-VolumesActionsTest-73769324 None] Converted 1024.00 MB image at 153.95 MB/s Aug 05 10:35:34 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-11fd2e28-097f-46c4-bfb0-071ecf17e25f tempest-VolumesActionsTest-73769324 None] bf93cb37-0225-48b4-91ba-379aba0af642 was raw, no need to convert to raw {{(pid=88736) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 05 10:35:34 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.640s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:34 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:35:34 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] Deleted volume successfully. Aug 05 10:35:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cabbd451-c286-4020-abcb-e8a2bad6aa7f tempest-SnapshotDependencyTests-1002724430 None] Lock "cinder-2a359860-7616-4993-88ef-93c47380b6e3-delete_volume" released by "delete_volume" :: held 2.930s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:35:43 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=30,cinder:INSERT=13,cinder:UPDATE=38,cinder:DELETE=2 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:35:44 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:INSERT=6,cinder:SELECT=48,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Flow 'volume_create_manager' (515c61d0-0608-4105-92a1-240c0f662115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3283683-6f5a-46a3-8e77-96b006f6faca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3283683-6f5a-46a3-8e77-96b006f6faca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1292389373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f059cf10-574b-4ec6-8b1b-094556c5d9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc72cdd3c3543de89634a27f5ffcd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:35:55Z,use_quota=True,user_id='9fc2e916719f4c47bf039bef25f0aefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25eae266-0c18-4815-bb8a-74223893955a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25eae266-0c18-4815-bb8a-74223893955a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4226d43f-d2b5-47a3-a84f-9bcfba198bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4226d43f-d2b5-47a3-a84f-9bcfba198bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f059cf10-574b-4ec6-8b1b-094556c5d9dc', 'volume_name': 'volume-f059cf10-574b-4ec6-8b1b-094556c5d9dc', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4aeba4-824b-4fa4-99d5-ea417084ee9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4aeba4-824b-4fa4-99d5-ea417084ee9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4364d4b0-23a8-4bcc-baa2-b4dcb04d01f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:54 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Volume f059cf10-574b-4ec6-8b1b-094556c5d9dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f059cf10-574b-4ec6-8b1b-094556c5d9dc', 'volume_size': 1} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-11fd2e28-097f-46c4-bfb0-071ecf17e25f tempest-VolumesActionsTest-73769324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.287s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-11fd2e28-097f-46c4-bfb0-071ecf17e25f tempest-VolumesActionsTest-73769324 None] Uploaded volume to glance image-id: bf93cb37-0225-48b4-91ba-379aba0af642. {{(pid=88736) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.216s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1292389373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f059cf10-574b-4ec6-8b1b-094556c5d9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc72cdd3c3543de89634a27f5ffcd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:35:55Z,use_quota=True,user_id='9fc2e916719f4c47bf039bef25f0aefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Creating volume f059cf10-574b-4ec6-8b1b-094556c5d9dc {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:35:54 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:35:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f059cf10-574b-4ec6-8b1b-094556c5d9dc 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:54 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f059cf10-574b-4ec6-8b1b-094556c5d9dc 1073741824 Aug 05 10:35:54 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:54 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-11fd2e28-097f-46c4-bfb0-071ecf17e25f tempest-VolumesActionsTest-73769324 None] Copy volume to image completed successfully. Aug 05 10:35:55 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f059cf10-574b-4ec6-8b1b-094556c5d9dc 1073741824" returned: 0 in 0.444s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f059cf10-574b-4ec6-8b1b-094556c5d9dc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:55 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f059cf10-574b-4ec6-8b1b-094556c5d9dc Aug 05 10:35:55 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:55 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f059cf10-574b-4ec6-8b1b-094556c5d9dc" returned: 0 in 0.256s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:35:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:35:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4364d4b0-23a8-4bcc-baa2-b4dcb04d01f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f059cf10-574b-4ec6-8b1b-094556c5d9dc', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79f2a14-3696-4cd8-8fd5-630e569d9b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:35:55 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Volume volume-f059cf10-574b-4ec6-8b1b-094556c5d9dc (f059cf10-574b-4ec6-8b1b-094556c5d9dc): created successfully Aug 05 10:35:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79f2a14-3696-4cd8-8fd5-630e569d9b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:35:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Flow 'volume_create_manager' (515c61d0-0608-4105-92a1-240c0f662115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:35:55 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-fc9dc2e4-0e7c-4876-9040-641decc1b90d tempest-AttachVolumeTestJSON-1541903996 None] Created volume successfully. Aug 05 10:35:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:35:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:35:56 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9b66b8-1008-4e21-b017-5653ab85f0b8]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:35:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:56 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c Aug 05 10:35:56 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:56 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c" returned: 0 in 0.347s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:56 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6744f6df-bcf6-49c4-a3fe-6f1f4de518b6]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:35:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:56 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c Aug 05 10:35:56 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:56 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Aug 05 10:35:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c" returned: 0 in 0.386s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:35:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.a333e4fc-65de-4e21-b693-9e9d81cd48f3l2jhw0rb.img {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:35:56 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.a333e4fc-65de-4e21-b693-9e9d81cd48f3l2jhw0rb.img Aug 05 10:35:56 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:35:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-a1f8296b-a93d-4175-8089-e76b4379480b req-696c05db-63c5-4215-be5e-aa7a6d292be7 tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:01 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.a333e4fc-65de-4e21-b693-9e9d81cd48f3l2jhw0rb.img" returned: 0 in 4.281s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:01 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ce4fcd-e8d9-41a6-b1ac-d1918949ac16]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:01 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c Aug 05 10:36:01 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:01 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c" returned: 0 in 0.527s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:01 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] Image conversion details: src /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c, size 1024.00 MB, duration 4.28 sec, destination /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.a333e4fc-65de-4e21-b693-9e9d81cd48f3l2jhw0rb.img {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:36:01 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] Converted 1024.00 MB image at 239.16 MB/s Aug 05 10:36:01 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] a333e4fc-65de-4e21-b693-9e9d81cd48f3 was raw, converting to qcow2 {{(pid=88736) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 05 10:36:01 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e957195f-0a1f-4c2d-8cee-fcac4deda5cb]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.a333e4fc-65de-4e21-b693-9e9d81cd48f3l2jhw0rb.img {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:01 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.a333e4fc-65de-4e21-b693-9e9d81cd48f3l2jhw0rb.img Aug 05 10:36:01 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:01 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.a333e4fc-65de-4e21-b693-9e9d81cd48f3l2jhw0rb.img" returned: 0 in 0.322s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.a333e4fc-65de-4e21-b693-9e9d81cd48f3l2jhw0rb.img {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:02 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.a333e4fc-65de-4e21-b693-9e9d81cd48f3l2jhw0rb.img Aug 05 10:36:02 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:02 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.a333e4fc-65de-4e21-b693-9e9d81cd48f3l2jhw0rb.img" returned: 1 in 0.312s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.a333e4fc-65de-4e21-b693-9e9d81cd48f3l2jhw0rb.img' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:36:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.a333e4fc-65de-4e21-b693-9e9d81cd48f3l2jhw0rb.img /opt/stack/data/cinder/conversion/vol_upload_r6s4utzg {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:02 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.a333e4fc-65de-4e21-b693-9e9d81cd48f3l2jhw0rb.img /opt/stack/data/cinder/conversion/vol_upload_r6s4utzg Aug 05 10:36:02 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:02 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.a333e4fc-65de-4e21-b693-9e9d81cd48f3l2jhw0rb.img /opt/stack/data/cinder/conversion/vol_upload_r6s4utzg" returned: 0 in 0.257s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:02 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] Image conversion details: src /opt/stack/data/cinder/conversion/114e6943-858f-464a-be9c-cb003701f59c.temp_image.a333e4fc-65de-4e21-b693-9e9d81cd48f3l2jhw0rb.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_r6s4utzg {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:36:02 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 05 10:36:02 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad72af3-058a-47d9-99c0-a208fd32ab2c]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_r6s4utzg {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:02 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_r6s4utzg Aug 05 10:36:02 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:02 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_r6s4utzg" returned: 0 in 0.322s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.080s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] Uploaded volume to glance image-id: a333e4fc-65de-4e21-b693-9e9d81cd48f3. {{(pid=88736) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 05 10:36:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-a1f8296b-a93d-4175-8089-e76b4379480b req-696c05db-63c5-4215-be5e-aa7a6d292be7 tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.368s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-a1f8296b-a93d-4175-8089-e76b4379480b req-696c05db-63c5-4215-be5e-aa7a6d292be7 tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:04 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-3797f7fe-74e0-4164-ac3a-9968cf9b3387 tempest-VolumesActionsTest-73769324 None] Copy volume to image completed successfully. Aug 05 10:36:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-a1f8296b-a93d-4175-8089-e76b4379480b req-696c05db-63c5-4215-be5e-aa7a6d292be7 tempest-AttachVolumeTestJSON-1541903996 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-f059cf10-574b-4ec6-8b1b-094556c5d9dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d3c72f5-1550-4e53-a132-47a87859ff1c', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:36:04 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-a1f8296b-a93d-4175-8089-e76b4379480b req-696c05db-63c5-4215-be5e-aa7a6d292be7 tempest-AttachVolumeTestJSON-1541903996 None] attachment_update completed successfully. Aug 05 10:36:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] Acquiring lock "cinder-114e6943-858f-464a-be9c-cb003701f59c-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] Lock "cinder-114e6943-858f-464a-be9c-cb003701f59c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] Acquiring lock "cinder-quobyte-114e6943-858f-464a-be9c-cb003701f59c" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] Lock "cinder-quobyte-114e6943-858f-464a-be9c-cb003701f59c" acquired by "delete_volume" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:05 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0768260d-6e09-47d0-847b-786172ab95de]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:05 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c Aug 05 10:36:05 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:05 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c" returned: 0 in 0.345s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:05 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c Aug 05 10:36:05 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:05 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-114e6943-858f-464a-be9c-cb003701f59c" returned: 0 in 0.240s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] Lock "cinder-quobyte-114e6943-858f-464a-be9c-cb003701f59c" released by "delete_volume" :: held 0.622s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:05 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] Created reservations ['7227ec56-0386-40d9-98e2-b4280c5afb08', '41bc0e4e-cbe7-4f5c-9248-bdc0517f2440', '9092f2ba-7297-42fa-8203-d035be7c37e1', 'ee77913e-c402-4e06-aae6-cddf2b92647e'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:36:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:36:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:36:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:05 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:36:05 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:06 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.251s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:36:06 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] Deleted volume successfully. Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-adde133c-38eb-4276-8a10-a2385b99b023 tempest-VolumesActionsTest-73769324 None] Lock "cinder-114e6943-858f-464a-be9c-cb003701f59c-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Flow 'volume_create_manager' (72a46cef-f843-4ce8-ba0a-7c8a2553bab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037914a2-8357-4167-9952-f8a7fc9125e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037914a2-8357-4167-9952-f8a7fc9125e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-870501784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51bab17f-ed6f-4425-83af-81dba2ae4717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc72cdd3c3543de89634a27f5ffcd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:36:07Z,use_quota=True,user_id='9fc2e916719f4c47bf039bef25f0aefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bba7f0-bb3b-4ccb-a174-f7ff7b880b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bba7f0-bb3b-4ccb-a174-f7ff7b880b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f7e8ab-a62a-454f-8f31-faa8e6ac6d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f7e8ab-a62a-454f-8f31-faa8e6ac6d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51bab17f-ed6f-4425-83af-81dba2ae4717', 'volume_name': 'volume-51bab17f-ed6f-4425-83af-81dba2ae4717', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24846c1e-68a2-4829-85ed-4767feb56ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24846c1e-68a2-4829-85ed-4767feb56ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1c2ae4-d600-4536-830c-d9433c4a0882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:06 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Volume 51bab17f-ed6f-4425-83af-81dba2ae4717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51bab17f-ed6f-4425-83af-81dba2ae4717', 'volume_size': 1} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-870501784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51bab17f-ed6f-4425-83af-81dba2ae4717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc72cdd3c3543de89634a27f5ffcd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:36:07Z,use_quota=True,user_id='9fc2e916719f4c47bf039bef25f0aefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Creating volume 51bab17f-ed6f-4425-83af-81dba2ae4717 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:36:06 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:36:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-51bab17f-ed6f-4425-83af-81dba2ae4717 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:06 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-51bab17f-ed6f-4425-83af-81dba2ae4717 1073741824 Aug 05 10:36:06 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:07 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-51bab17f-ed6f-4425-83af-81dba2ae4717 1073741824" returned: 0 in 0.471s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-51bab17f-ed6f-4425-83af-81dba2ae4717 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:07 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-51bab17f-ed6f-4425-83af-81dba2ae4717 Aug 05 10:36:07 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:07 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-51bab17f-ed6f-4425-83af-81dba2ae4717" returned: 0 in 0.253s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:36:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1c2ae4-d600-4536-830c-d9433c4a0882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51bab17f-ed6f-4425-83af-81dba2ae4717', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da65fb32-ceee-4b93-b72f-fe7bfa6cd511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:07 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Volume volume-51bab17f-ed6f-4425-83af-81dba2ae4717 (51bab17f-ed6f-4425-83af-81dba2ae4717): created successfully Aug 05 10:36:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da65fb32-ceee-4b93-b72f-fe7bfa6cd511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Flow 'volume_create_manager' (72a46cef-f843-4ce8-ba0a-7c8a2553bab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:36:07 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d171e67f-ebb3-4ceb-b455-dbb54a42deeb tempest-AttachVolumeTestJSON-1541903996 None] Created volume successfully. Aug 05 10:36:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-661129a1-62a5-47bc-a472-09473a346ff7 req-4d0a3b4f-c97a-48d1-9acd-b1e09b8c01f7 tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-661129a1-62a5-47bc-a472-09473a346ff7 req-4d0a3b4f-c97a-48d1-9acd-b1e09b8c01f7 tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-661129a1-62a5-47bc-a472-09473a346ff7 req-4d0a3b4f-c97a-48d1-9acd-b1e09b8c01f7 tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-661129a1-62a5-47bc-a472-09473a346ff7 req-4d0a3b4f-c97a-48d1-9acd-b1e09b8c01f7 tempest-AttachVolumeTestJSON-1541903996 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-51bab17f-ed6f-4425-83af-81dba2ae4717', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4169e288-c5f7-4223-84f4-5ca00d7aed8b', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:36:09 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-661129a1-62a5-47bc-a472-09473a346ff7 req-4d0a3b4f-c97a-48d1-9acd-b1e09b8c01f7 tempest-AttachVolumeTestJSON-1541903996 None] attachment_update completed successfully. Aug 05 10:36:11 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-51125bc0-862c-45e3-a71c-e2eb6801dfa9 req-21c00d48-cab7-49f2-bf48-21062e4aa29b tempest-AttachVolumeTestJSON-1541903996 None] Terminate volume connection completed successfully. Aug 05 10:36:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-51125bc0-862c-45e3-a71c-e2eb6801dfa9 req-21c00d48-cab7-49f2-bf48-21062e4aa29b tempest-AttachVolumeTestJSON-1541903996 None] Deleting attachment 0d3c72f5-1550-4e53-a132-47a87859ff1c. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:36:12 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-2132fde7-e1f1-4a38-aef6-04f79f3a8089 req-fd54ad07-fcf6-4ee5-b3ba-245476a9a346 tempest-AttachVolumeTestJSON-1541903996 None] Terminate volume connection completed successfully. Aug 05 10:36:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-2132fde7-e1f1-4a38-aef6-04f79f3a8089 req-fd54ad07-fcf6-4ee5-b3ba-245476a9a346 tempest-AttachVolumeTestJSON-1541903996 None] Deleting attachment 4169e288-c5f7-4223-84f4-5ca00d7aed8b. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:36:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:36:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:36:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:36:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:13 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:36:13 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:14 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.283s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Flow 'volume_create_manager' (78cf6bad-33db-4278-9dc7-b2b6735d0fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd2e80d-b182-49ce-9c9a-8b5154bfcadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd2e80d-b182-49ce-9c9a-8b5154bfcadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2052256007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29775f18-0af7-4e31-9d28-7d770d8812f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239a28b2877641c68a063409a54b7d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:36:15Z,use_quota=True,user_id='243f636a69f048388825e0b8c897614a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be3a1f3-483a-4cf3-adf6-274f26ff8b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be3a1f3-483a-4cf3-adf6-274f26ff8b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8520e392-0818-4fa5-918c-58f022808fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8520e392-0818-4fa5-918c-58f022808fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29775f18-0af7-4e31-9d28-7d770d8812f9', 'volume_name': 'volume-29775f18-0af7-4e31-9d28-7d770d8812f9', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7650c9-a6ef-4195-addd-6f6374e3c1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7650c9-a6ef-4195-addd-6f6374e3c1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a37cf6-5caa-420a-911b-a0fb2f30e569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:14 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Volume 29775f18-0af7-4e31-9d28-7d770d8812f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29775f18-0af7-4e31-9d28-7d770d8812f9', 'volume_size': 1} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2052256007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29775f18-0af7-4e31-9d28-7d770d8812f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239a28b2877641c68a063409a54b7d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:36:15Z,use_quota=True,user_id='243f636a69f048388825e0b8c897614a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Creating volume 29775f18-0af7-4e31-9d28-7d770d8812f9 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:36:14 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:36:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:14 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9 1073741824 Aug 05 10:36:14 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:15 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9 1073741824" returned: 0 in 0.493s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:15 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9 Aug 05 10:36:15 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:15 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9" returned: 0 in 0.299s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:36:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a37cf6-5caa-420a-911b-a0fb2f30e569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29775f18-0af7-4e31-9d28-7d770d8812f9', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce988a04-e9ac-412c-8ca9-ac550bf79d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:15 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Volume volume-29775f18-0af7-4e31-9d28-7d770d8812f9 (29775f18-0af7-4e31-9d28-7d770d8812f9): created successfully Aug 05 10:36:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce988a04-e9ac-412c-8ca9-ac550bf79d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Flow 'volume_create_manager' (78cf6bad-33db-4278-9dc7-b2b6735d0fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:36:15 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-f1c7e7b0-5718-4aa2-9111-a38bdf2f9a41 tempest-VolumesSnapshotListTestJSON-1419374351 None] Created volume successfully. Aug 05 10:36:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] Creating offline snapshot 0a9989a6-e674-4017-aa60-83729f7e50ec of volume 29775f18-0af7-4e31-9d28-7d770d8812f9 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:36:17 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[081c7659-85de-462c-b4c9-ce0c0d8a3eca]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:17 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9 Aug 05 10:36:17 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:17 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9" returned: 0 in 0.379s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "cinder-51bab17f-ed6f-4425-83af-81dba2ae4717-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:17 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec 1G Aug 05 10:36:17 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] Lock "cinder-51bab17f-ed6f-4425-83af-81dba2ae4717-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "cinder-quobyte-51bab17f-ed6f-4425-83af-81dba2ae4717" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] Lock "cinder-quobyte-51bab17f-ed6f-4425-83af-81dba2ae4717" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:17 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e8409c-5087-4a01-8c6c-ec46b0500613]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-51bab17f-ed6f-4425-83af-81dba2ae4717 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:17 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-51bab17f-ed6f-4425-83af-81dba2ae4717 Aug 05 10:36:17 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:17 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec 1G" returned: 0 in 0.432s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29775f18-0af7-4e31-9d28-7d770d8812f9 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:17 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29775f18-0af7-4e31-9d28-7d770d8812f9 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec Aug 05 10:36:17 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:17 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-51bab17f-ed6f-4425-83af-81dba2ae4717" returned: 0 in 0.386s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-51bab17f-ed6f-4425-83af-81dba2ae4717 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:17 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-51bab17f-ed6f-4425-83af-81dba2ae4717 Aug 05 10:36:17 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:18 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29775f18-0af7-4e31-9d28-7d770d8812f9 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec" returned: 0 in 0.291s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:18 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec is being set with open permissions: ugo+rw Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:18 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec Aug 05 10:36:18 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:18 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-51bab17f-ed6f-4425-83af-81dba2ae4717" returned: 0 in 0.267s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] Lock "cinder-quobyte-51bab17f-ed6f-4425-83af-81dba2ae4717" released by "delete_volume" :: held 0.697s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] Created reservations ['0062bac8-969a-40f8-9e14-06d9713fd640', 'd3f6452b-919f-46e9-9e74-3265a7cec47a', '0f2ca4a8-537a-4104-80e6-506d73e5065b', 'ead6a63a-02fd-4592-a6b5-c11f668c15ba'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:18 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:36:18 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:18 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec" returned: 0 in 0.245s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:18 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.info Aug 05 10:36:18 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:18 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "cinder-f059cf10-574b-4ec6-8b1b-094556c5d9dc-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.272s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:36:18 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] Deleted volume successfully. Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] Lock "cinder-f059cf10-574b-4ec6-8b1b-094556c5d9dc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-14c5c0fd-30d8-4b14-873f-124679869d4d tempest-AttachVolumeTestJSON-1541903996 None] Lock "cinder-51bab17f-ed6f-4425-83af-81dba2ae4717-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "cinder-quobyte-f059cf10-574b-4ec6-8b1b-094556c5d9dc" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:18 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] Lock "cinder-quobyte-f059cf10-574b-4ec6-8b1b-094556c5d9dc" acquired by "delete_volume" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.info" returned: 0 in 0.286s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:18 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.info is being set with open permissions: ugo+rw Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[97009ae9-4ff5-488c-8ede-6ee6470712a4]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f059cf10-574b-4ec6-8b1b-094556c5d9dc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:18 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.info Aug 05 10:36:18 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:18 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f059cf10-574b-4ec6-8b1b-094556c5d9dc Aug 05 10:36:18 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:18 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.info" returned: 0 in 0.255s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.976s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:19 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-90435f68-1df6-45f4-aa16-cc6373e7f900 tempest-VolumesSnapshotListTestJSON-1419374351 None] Create snapshot completed successfully Aug 05 10:36:19 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f059cf10-574b-4ec6-8b1b-094556c5d9dc" returned: 0 in 0.371s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f059cf10-574b-4ec6-8b1b-094556c5d9dc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:19 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f059cf10-574b-4ec6-8b1b-094556c5d9dc Aug 05 10:36:19 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:19 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f059cf10-574b-4ec6-8b1b-094556c5d9dc" returned: 0 in 0.236s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] Lock "cinder-quobyte-f059cf10-574b-4ec6-8b1b-094556c5d9dc" released by "delete_volume" :: held 0.648s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] Created reservations ['e1735ba5-c77a-4b65-85db-c8f72e157fde', '90713bd4-9e76-4727-8b47-068e5855d165', '127c01fc-c841-47eb-abfa-c746b0ac411f', '4a0bf7aa-43b0-45df-86f0-13566aae9f77'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:19 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:36:19 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:19 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.257s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:36:19 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] Deleted volume successfully. Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9e8075db-2219-4452-8303-c3156e8cbd40 tempest-AttachVolumeTestJSON-1541903996 None] Lock "cinder-f059cf10-574b-4ec6-8b1b-094556c5d9dc-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "cinder-073e0d88-c27c-4db2-b425-f62a3247174a-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] Lock "cinder-073e0d88-c27c-4db2-b425-f62a3247174a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "cinder-quobyte-073e0d88-c27c-4db2-b425-f62a3247174a" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] Lock "cinder-quobyte-073e0d88-c27c-4db2-b425-f62a3247174a" acquired by "delete_volume" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05cc28a-45c5-4a9c-afd7-27d68ed9e925]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-073e0d88-c27c-4db2-b425-f62a3247174a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:20 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-073e0d88-c27c-4db2-b425-f62a3247174a Aug 05 10:36:20 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1a3f2b87-63b8-48f8-9a5a-94a121e9a6ae tempest-VolumesSnapshotListTestJSON-1419374351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1a3f2b87-63b8-48f8-9a5a-94a121e9a6ae tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-1a3f2b87-63b8-48f8-9a5a-94a121e9a6ae tempest-VolumesSnapshotListTestJSON-1419374351 None] Creating offline snapshot c042d235-4feb-478a-ae5c-1242b7306e8f of volume 29775f18-0af7-4e31-9d28-7d770d8812f9 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:36:20 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-073e0d88-c27c-4db2-b425-f62a3247174a" returned: 0 in 0.398s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-073e0d88-c27c-4db2-b425-f62a3247174a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dcf999-6db8-450e-a448-0e3f161cefbe]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1a3f2b87-63b8-48f8-9a5a-94a121e9a6ae tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:20 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-073e0d88-c27c-4db2-b425-f62a3247174a Aug 05 10:36:20 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:20 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec Aug 05 10:36:20 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:20 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-073e0d88-c27c-4db2-b425-f62a3247174a" returned: 0 in 0.255s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] Lock "cinder-quobyte-073e0d88-c27c-4db2-b425-f62a3247174a" released by "delete_volume" :: held 0.692s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] Created reservations ['9fbebb79-c6a7-4f92-9cb9-6dbfc25164f1', '7161dcbf-c7d0-4d9a-8014-966eeb8ddc73', '1043b4b0-d880-4568-a266-59d0deca2be0', 'f5642a36-6181-4dd2-ba9a-5dcbba9d2d39'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:36:20 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1a3f2b87-63b8-48f8-9a5a-94a121e9a6ae tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec" returned: 0 in 0.382s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-1a3f2b87-63b8-48f8-9a5a-94a121e9a6ae tempest-VolumesSnapshotListTestJSON-1419374351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29775f18-0af7-4e31-9d28-7d770d8812f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1a3f2b87-63b8-48f8-9a5a-94a121e9a6ae tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:20 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f 1G Aug 05 10:36:20 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:20 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:36:20 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:21 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.246s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:21 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:36:21 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] Deleted volume successfully. Aug 05 10:36:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-389b0cb0-dc32-48e2-8f45-b989a97c1fd5 tempest-AttachVolumeTestJSON-1541903996 None] Lock "cinder-073e0d88-c27c-4db2-b425-f62a3247174a-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:21 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1a3f2b87-63b8-48f8-9a5a-94a121e9a6ae tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f 1G" returned: 0 in 0.458s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1a3f2b87-63b8-48f8-9a5a-94a121e9a6ae tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:21 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f Aug 05 10:36:21 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:21 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1a3f2b87-63b8-48f8-9a5a-94a121e9a6ae tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f" returned: 0 in 0.308s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:21 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-1a3f2b87-63b8-48f8-9a5a-94a121e9a6ae tempest-VolumesSnapshotListTestJSON-1419374351 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f is being set with open permissions: ugo+rw Aug 05 10:36:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1a3f2b87-63b8-48f8-9a5a-94a121e9a6ae tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:21 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f Aug 05 10:36:21 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:21 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1a3f2b87-63b8-48f8-9a5a-94a121e9a6ae tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f" returned: 0 in 0.260s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1a3f2b87-63b8-48f8-9a5a-94a121e9a6ae tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.521s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:21 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1a3f2b87-63b8-48f8-9a5a-94a121e9a6ae tempest-VolumesSnapshotListTestJSON-1419374351 None] Create snapshot completed successfully Aug 05 10:36:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b94a81b6-225a-4c6f-b0fb-9ec136229c46 tempest-VolumesSnapshotListTestJSON-1419374351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b94a81b6-225a-4c6f-b0fb-9ec136229c46 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b94a81b6-225a-4c6f-b0fb-9ec136229c46 tempest-VolumesSnapshotListTestJSON-1419374351 None] Creating offline snapshot 4c408031-88aa-4d89-9181-bcd97162be4c of volume 29775f18-0af7-4e31-9d28-7d770d8812f9 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:36:22 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbff6952-dd3e-4c3f-903a-62d8d5dd47d5]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b94a81b6-225a-4c6f-b0fb-9ec136229c46 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:22 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f Aug 05 10:36:22 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:22 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b94a81b6-225a-4c6f-b0fb-9ec136229c46 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f" returned: 0 in 0.349s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b94a81b6-225a-4c6f-b0fb-9ec136229c46 tempest-VolumesSnapshotListTestJSON-1419374351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29775f18-0af7-4e31-9d28-7d770d8812f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:36:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b94a81b6-225a-4c6f-b0fb-9ec136229c46 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:23 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c 1G Aug 05 10:36:23 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:23 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b94a81b6-225a-4c6f-b0fb-9ec136229c46 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c 1G" returned: 0 in 0.474s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b94a81b6-225a-4c6f-b0fb-9ec136229c46 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:23 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c Aug 05 10:36:23 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:23 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b94a81b6-225a-4c6f-b0fb-9ec136229c46 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c" returned: 0 in 0.339s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:23 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-b94a81b6-225a-4c6f-b0fb-9ec136229c46 tempest-VolumesSnapshotListTestJSON-1419374351 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c is being set with open permissions: ugo+rw Aug 05 10:36:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b94a81b6-225a-4c6f-b0fb-9ec136229c46 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:23 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c Aug 05 10:36:23 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:24 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b94a81b6-225a-4c6f-b0fb-9ec136229c46 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c" returned: 0 in 0.250s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b94a81b6-225a-4c6f-b0fb-9ec136229c46 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.504s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:24 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b94a81b6-225a-4c6f-b0fb-9ec136229c46 tempest-VolumesSnapshotListTestJSON-1419374351 None] Create snapshot completed successfully Aug 05 10:36:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Acquiring lock "cinder-4c408031-88aa-4d89-9181-bcd97162be4c-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-4c408031-88aa-4d89-9181-bcd97162be4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Acquiring lock "cinder-quobyte-29775f18-0af7-4e31-9d28-7d770d8812f9" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-quobyte-29775f18-0af7-4e31-9d28-7d770d8812f9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Acquiring lock "cinder-quobyte-4c408031-88aa-4d89-9181-bcd97162be4c" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-quobyte-4c408031-88aa-4d89-9181-bcd97162be4c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Deleting offline snapshot 4c408031-88aa-4d89-9181-bcd97162be4c of volume 29775f18-0af7-4e31-9d28-7d770d8812f9 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:36:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] snapshot_file for this snap is: volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:36:25 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaff2c8-74fb-48b8-8cb1-8e20c77c42ea]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:25 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c Aug 05 10:36:25 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:25 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c" returned: 0 in 0.361s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29775f18-0af7-4e31-9d28-7d770d8812f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:36:25 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc62aa38-6896-4dad-bd73-5c76f6804c35]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:26 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f Aug 05 10:36:26 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:26 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f" returned: 0 in 0.372s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:26 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29775f18-0af7-4e31-9d28-7d770d8812f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:36:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:26 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c Aug 05 10:36:26 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:26 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c" returned: 0 in 0.421s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:26 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c Aug 05 10:36:26 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:27 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.4c408031-88aa-4d89-9181-bcd97162be4c" returned: 0 in 0.257s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-quobyte-4c408031-88aa-4d89-9181-bcd97162be4c" released by "_delete_snapshot" :: held 1.509s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-quobyte-29775f18-0af7-4e31-9d28-7d770d8812f9" released by "delete_snapshot" :: held 1.532s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:27 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Created reservations ['4febefe5-8540-4dc7-b9e5-d4fdac22c1e4', '0c7f9ced-a49b-4771-859d-5f2a6a91ea8b', '571cbd77-618d-4006-8655-33784708fc0f', '530c714a-2e14-49b4-bc9c-d4967328083d'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:36:27 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Delete snapshot completed successfully. Aug 05 10:36:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1358bcf8-35c3-450c-8ea8-ee9beab91650 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-4c408031-88aa-4d89-9181-bcd97162be4c-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Acquiring lock "cinder-c042d235-4feb-478a-ae5c-1242b7306e8f-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-c042d235-4feb-478a-ae5c-1242b7306e8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Acquiring lock "cinder-quobyte-29775f18-0af7-4e31-9d28-7d770d8812f9" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-quobyte-29775f18-0af7-4e31-9d28-7d770d8812f9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Acquiring lock "cinder-quobyte-c042d235-4feb-478a-ae5c-1242b7306e8f" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-quobyte-c042d235-4feb-478a-ae5c-1242b7306e8f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:27 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Deleting offline snapshot c042d235-4feb-478a-ae5c-1242b7306e8f of volume 29775f18-0af7-4e31-9d28-7d770d8812f9 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:36:27 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] snapshot_file for this snap is: volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:36:27 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-55b26213-610e-42f3-b7ec-0ad4f2ef2f6a tempest-GroupsV314Test-1825422432 None] Group tempest-GroupsV314Test-Group-1838553282: creating Aug 05 10:36:27 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff78a0f-7054-4716-88d4-4ff782fa1b37]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:27 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-55b26213-610e-42f3-b7ec-0ad4f2ef2f6a tempest-GroupsV314Test-1825422432 None] Group tempest-GroupsV314Test-Group-1838553282: created successfully Aug 05 10:36:27 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-55b26213-610e-42f3-b7ec-0ad4f2ef2f6a tempest-GroupsV314Test-1825422432 None] Create group completed successfully. Aug 05 10:36:27 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f Aug 05 10:36:27 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:28 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f" returned: 0 in 0.349s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29775f18-0af7-4e31-9d28-7d770d8812f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:36:28 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3361ef-39ae-49c5-98ff-dd8792f807e0]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:28 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec Aug 05 10:36:28 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:28 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec" returned: 0 in 0.344s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29775f18-0af7-4e31-9d28-7d770d8812f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:36:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:28 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f Aug 05 10:36:28 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:28 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f" returned: 0 in 0.408s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:28 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f Aug 05 10:36:28 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:29 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.c042d235-4feb-478a-ae5c-1242b7306e8f" returned: 0 in 0.257s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-quobyte-c042d235-4feb-478a-ae5c-1242b7306e8f" released by "_delete_snapshot" :: held 1.469s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-quobyte-29775f18-0af7-4e31-9d28-7d770d8812f9" released by "delete_snapshot" :: held 1.503s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Created reservations ['92a17acb-25c9-4120-91f0-e7f6fc003d79', '18048993-9620-4527-8280-b1fba5bebd52', 'bcee23d4-a725-4be0-bdaa-509ad80df581', '706a67e6-ab65-440a-933d-315f215be981'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Flow 'volume_create_manager' (15c39cf1-2d82-4990-815d-b8651cfee785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40495a70-3918-4339-84a4-8c9c434ddae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:29 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Delete snapshot completed successfully. Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40495a70-3918-4339-84a4-8c9c434ddae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1968879612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cd7ff468-e342-427c-bae4-af3af905d6c8,host='devstack@QuobyteHD#QuobyteHD',id=416dd5f6-f1bc-4aa3-9fc6-c4c024302740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615b854714a24e00b89c34629d97a7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:36:29Z,use_quota=True,user_id='8e8c88b7e45a4926be652bfd51b0fa80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12e25a87-e99d-4e47-a7d6-98e9a780e926),volume_type_id=12e25a87-e99d-4e47-a7d6-98e9a780e926)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d1f7b3-a66a-4397-ae53-b576a0dba781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d1f7b3-a66a-4397-ae53-b576a0dba781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d831d980-ff90-474d-aa66-e568cf94a847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d831d980-ff90-474d-aa66-e568cf94a847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '416dd5f6-f1bc-4aa3-9fc6-c4c024302740', 'volume_name': 'volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca756268-9b15-4caf-b214-d5a7753d63c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca756268-9b15-4caf-b214-d5a7753d63c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e0a55e-aff9-4113-99e2-ffa55871837c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:29 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Volume 416dd5f6-f1bc-4aa3-9fc6-c4c024302740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740', 'volume_size': 1} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cd7ff468-e342-427c-bae4-af3af905d6c8,created_at=2026-08-05T08:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1968879612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cd7ff468-e342-427c-bae4-af3af905d6c8,host='devstack@QuobyteHD#QuobyteHD',id=416dd5f6-f1bc-4aa3-9fc6-c4c024302740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615b854714a24e00b89c34629d97a7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:36:29Z,use_quota=True,user_id='8e8c88b7e45a4926be652bfd51b0fa80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12e25a87-e99d-4e47-a7d6-98e9a780e926),volume_type_id=12e25a87-e99d-4e47-a7d6-98e9a780e926)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Creating volume 416dd5f6-f1bc-4aa3-9fc6-c4c024302740 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:36:29 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9cd937eb-ba2d-4fe8-84ca-76ac6be21067 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-c042d235-4feb-478a-ae5c-1242b7306e8f-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:29 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 1073741824 Aug 05 10:36:29 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] Acquiring lock "cinder-0a9989a6-e674-4017-aa60-83729f7e50ec-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:29 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 1073741824" returned: 0 in 0.428s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-0a9989a6-e674-4017-aa60-83729f7e50ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] Acquiring lock "cinder-quobyte-29775f18-0af7-4e31-9d28-7d770d8812f9" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-quobyte-29775f18-0af7-4e31-9d28-7d770d8812f9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] Acquiring lock "cinder-quobyte-0a9989a6-e674-4017-aa60-83729f7e50ec" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-quobyte-0a9989a6-e674-4017-aa60-83729f7e50ec" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] Deleting offline snapshot 0a9989a6-e674-4017-aa60-83729f7e50ec of volume 29775f18-0af7-4e31-9d28-7d770d8812f9 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] snapshot_file for this snap is: volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af4225e-f373-4795-bc40-0a20462ae63b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:29 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 Aug 05 10:36:29 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:30 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec Aug 05 10:36:30 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:30 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740" returned: 0 in 0.255s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:36:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e0a55e-aff9-4113-99e2-ffa55871837c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87bcde1d-e0f0-43c0-84ba-064da9e39748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:30 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Volume volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 (416dd5f6-f1bc-4aa3-9fc6-c4c024302740): created successfully Aug 05 10:36:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87bcde1d-e0f0-43c0-84ba-064da9e39748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Flow 'volume_create_manager' (15c39cf1-2d82-4990-815d-b8651cfee785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:36:30 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-20d2ceff-7407-473f-8df1-3986f572bbcc tempest-GroupsV314Test-1825422432 None] Created volume successfully. Aug 05 10:36:30 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec" returned: 0 in 0.369s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29775f18-0af7-4e31-9d28-7d770d8812f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:36:30 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2c0a86-3cce-408f-8e5e-5e0f32e2470a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:30 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9 Aug 05 10:36:30 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:30 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9" returned: 0 in 0.368s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:30 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec Aug 05 10:36:30 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:31 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec" returned: 0 in 0.354s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:31 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec Aug 05 10:36:31 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:31 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9.0a9989a6-e674-4017-aa60-83729f7e50ec" returned: 0 in 0.266s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:31 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Cloning volume 416dd5f6-f1bc-4aa3-9fc6-c4c024302740 to volume d5be2c5b-5fd2-4b6a-9571-0816f7483025 Aug 05 10:36:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-quobyte-0a9989a6-e674-4017-aa60-83729f7e50ec" released by "_delete_snapshot" :: held 1.493s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Creating offline snapshot 609d706b-00a0-42e4-930f-7063194b1dcb of volume 416dd5f6-f1bc-4aa3-9fc6-c4c024302740 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:36:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-quobyte-29775f18-0af7-4e31-9d28-7d770d8812f9" released by "delete_snapshot" :: held 1.529s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:31 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f0f6bc-c718-4695-a140-125514c9a438]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:31 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] Created reservations ['58d01078-97fb-47a4-b05e-a8287f9a14d4', '166d4c74-c7f8-41dc-86cf-55363c459a0f', 'd6eaba69-1d98-4174-9f41-db14fcf024d4', '40d7af93-f9a4-4c0e-918c-c1ec14f42d2a'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:36:31 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] Delete snapshot completed successfully. Aug 05 10:36:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0abe4f47-e241-43c5-835d-8f520fc87ba8 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-0a9989a6-e674-4017-aa60-83729f7e50ec-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:31 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 Aug 05 10:36:31 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:31 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740" returned: 0 in 0.439s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:31 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb 1G Aug 05 10:36:31 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] Acquiring lock "cinder-29775f18-0af7-4e31-9d28-7d770d8812f9-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-29775f18-0af7-4e31-9d28-7d770d8812f9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] Acquiring lock "cinder-quobyte-29775f18-0af7-4e31-9d28-7d770d8812f9" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-quobyte-29775f18-0af7-4e31-9d28-7d770d8812f9" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[10771a93-3089-4d84-9660-4f09d920adc2]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:32 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9 Aug 05 10:36:32 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:32 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb 1G" returned: 0 in 0.428s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:32 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb Aug 05 10:36:32 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:32 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9" returned: 0 in 0.358s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:32 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9 Aug 05 10:36:32 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:32 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb" returned: 0 in 0.293s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:32 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:32 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb Aug 05 10:36:32 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:32 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-29775f18-0af7-4e31-9d28-7d770d8812f9" returned: 0 in 0.261s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-quobyte-29775f18-0af7-4e31-9d28-7d770d8812f9" released by "delete_volume" :: held 0.684s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:32 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb" returned: 0 in 0.258s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] Created reservations ['3db5b99a-ba75-4d3f-aad6-f90cb1792722', '9abe1bc2-5880-45ef-ae4b-86e0d6062c5b', 'cc0eb94b-8b17-4e02-98c4-208ea4d845d0', '15d00bca-6288-4806-89be-4198dadf0c3c'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:32 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.info Aug 05 10:36:32 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:32 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:36:32 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:33 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.info" returned: 0 in 0.260s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:33 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:33 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.info Aug 05 10:36:33 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:33 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.255s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:36:33 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] Deleted volume successfully. Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1985dd3b-78e6-4e13-8279-4d264f5fa8b2 tempest-VolumesSnapshotListTestJSON-1419374351 None] Lock "cinder-29775f18-0af7-4e31-9d28-7d770d8812f9-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:33 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.info" returned: 0 in 0.262s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Acquiring lock "cinder-quobyte-d5be2c5b-5fd2-4b6a-9571-0816f7483025" by "_copy_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Lock "cinder-quobyte-d5be2c5b-5fd2-4b6a-9571-0816f7483025" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] snapshot: 609d706b-00a0-42e4-930f-7063194b1dcb, volume: d5be2c5b-5fd2-4b6a-9571-0816f7483025, {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14479c9-c10a-4f1f-bd39-3cb1b7b100fd]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:33 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb Aug 05 10:36:33 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:33 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb" returned: 0 in 0.360s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[088dd003-30bc-4f7f-99ed-3865f72d03b7]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:33 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 Aug 05 10:36:33 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:34 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740" returned: 0 in 0.386s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] will copy from snapshot at /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:36:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Creating direct copy from snapshot {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:36:34 devstack cinder-volume[88736]: DEBUG cinder.utils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Path /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d5be2c5b-5fd2-4b6a-9571-0816f7483025 not found in is_blk_device check {{(pid=88736) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:36:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d5be2c5b-5fd2-4b6a-9571-0816f7483025 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:34 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d5be2c5b-5fd2-4b6a-9571-0816f7483025 Aug 05 10:36:34 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:39 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d5be2c5b-5fd2-4b6a-9571-0816f7483025" returned: 0 in 4.920s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:39 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Image conversion details: src /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740, size 1024.00 MB, duration 4.92 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d5be2c5b-5fd2-4b6a-9571-0816f7483025 {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:36:39 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Converted 1024.00 MB image at 208.08 MB/s Aug 05 10:36:39 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d5be2c5b-5fd2-4b6a-9571-0816f7483025 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 10:36:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d5be2c5b-5fd2-4b6a-9571-0816f7483025 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:39 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d5be2c5b-5fd2-4b6a-9571-0816f7483025 Aug 05 10:36:39 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:39 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d5be2c5b-5fd2-4b6a-9571-0816f7483025" returned: 0 in 0.258s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Lock "cinder-quobyte-d5be2c5b-5fd2-4b6a-9571-0816f7483025" released by "_copy_volume_from_snapshot" :: held 6.001s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Acquiring lock "cinder-quobyte-609d706b-00a0-42e4-930f-7063194b1dcb" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Lock "cinder-quobyte-609d706b-00a0-42e4-930f-7063194b1dcb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Deleting offline snapshot 609d706b-00a0-42e4-930f-7063194b1dcb of volume 416dd5f6-f1bc-4aa3-9fc6-c4c024302740 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:36:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] snapshot_file for this snap is: volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:36:39 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb216ce0-bde8-459e-96d3-ee49006e1fc1]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:39 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb Aug 05 10:36:39 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:39 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb" returned: 0 in 0.363s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:36:39 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f61fdc-38a4-4d8e-ad1e-5bb9ce0a247f]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:40 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 Aug 05 10:36:40 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:40 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740" returned: 0 in 0.585s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:40 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb Aug 05 10:36:40 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:40 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb" returned: 0 in 0.349s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:40 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb Aug 05 10:36:40 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:41 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740.609d706b-00a0-42e4-930f-7063194b1dcb" returned: 0 in 0.251s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Lock "cinder-quobyte-609d706b-00a0-42e4-930f-7063194b1dcb" released by "_delete_snapshot" :: held 1.645s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.828s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:41 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-63529d3e-c35e-428b-b471-9895b730437a tempest-GroupsV314Test-1825422432 None] Create group from source-group-cd7ff468-e342-427c-bae4-af3af905d6c8 completed successfully. Aug 05 10:36:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] Acquiring lock "cinder-quobyte-d5be2c5b-5fd2-4b6a-9571-0816f7483025" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] Lock "cinder-quobyte-d5be2c5b-5fd2-4b6a-9571-0816f7483025" acquired by "delete_volume" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:42 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca8ad76-dcb1-4a2d-87df-d138579cb6c7]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d5be2c5b-5fd2-4b6a-9571-0816f7483025 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:42 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d5be2c5b-5fd2-4b6a-9571-0816f7483025 Aug 05 10:36:42 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:42 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d5be2c5b-5fd2-4b6a-9571-0816f7483025" returned: 0 in 0.431s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d5be2c5b-5fd2-4b6a-9571-0816f7483025 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:42 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d5be2c5b-5fd2-4b6a-9571-0816f7483025 Aug 05 10:36:42 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:42 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d5be2c5b-5fd2-4b6a-9571-0816f7483025" returned: 0 in 0.370s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] Lock "cinder-quobyte-d5be2c5b-5fd2-4b6a-9571-0816f7483025" released by "delete_volume" :: held 0.851s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:43 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] Created reservations ['6beb4968-37a1-49d9-a140-22eb72cb018b'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:36:43 devstack cinder-volume[88736]: WARNING cinder.quota [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-422557063 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-422557063, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:36:43 devstack cinder-volume[88736]: WARNING cinder.quota [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-422557063 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-422557063, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:36:43 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] Created reservations ['75dc8e8c-a98d-4200-8057-51e6b3cc5e4a', '7fc0ce32-362f-4837-bda9-2bb652c3334c', '61e794be-4037-4bdf-87ef-1f899bbe993f', 'fc4d1da4-b8c9-4ba4-b92a-9d3b2186225e'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:36:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:36:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:36:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:43 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:36:43 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:43 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.314s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:43 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:36:43 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-67b8bd68-2497-491c-92c7-1b5353431d27 tempest-GroupsV314Test-1825422432 None] Delete group completed successfully. Aug 05 10:36:43 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] Acquiring lock "cinder-quobyte-416dd5f6-f1bc-4aa3-9fc6-c4c024302740" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:36:43 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] Lock "cinder-quobyte-416dd5f6-f1bc-4aa3-9fc6-c4c024302740" acquired by "delete_volume" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:36:43 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa889f6b-cefe-4052-9f3f-b86f1a21d142]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:36:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:43 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 Aug 05 10:36:43 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:44 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740" returned: 0 in 0.412s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:44 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740 Aug 05 10:36:44 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:44 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-416dd5f6-f1bc-4aa3-9fc6-c4c024302740" returned: 0 in 0.303s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] Lock "cinder-quobyte-416dd5f6-f1bc-4aa3-9fc6-c4c024302740" released by "delete_volume" :: held 0.822s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:36:44 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] Created reservations ['59997c27-c4d7-4264-b8f0-107e1125922b'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:36:44 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] Created reservations ['75d40069-dbf1-4e77-89c1-0ee5139a9100', '636930a8-c783-4564-81dc-25cab1be20f2', 'aaf7a614-c015-4230-9f0f-7a5f30ad2ff0', '2e43127f-9717-4b2f-ad59-9702acac9763'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:36:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:36:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:36:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:44 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:36:44 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:45 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.313s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:45 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:36:45 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8b499c93-7e24-46cb-9709-c6c443c37738 tempest-GroupsV314Test-1825422432 None] Delete group completed successfully. Aug 05 10:36:54 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=99,cinder:UPDATE=101,cinder:DELETE=9,cinder:INSERT=29 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:36:54 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:UPDATE=104,cinder:SELECT=99,cinder:INSERT=20,cinder:DELETE=3 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Flow 'volume_create_manager' (7e45534d-9307-4786-a39f-5ee73792830a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5ab195-e423-47a1-918d-fc82b53fa8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5ab195-e423-47a1-918d-fc82b53fa8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1720647088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd4b23b-6e13-4444-9abd-24972f73c27c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfebf3a903f44ab6b893adf641d16e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:36:58Z,use_quota=True,user_id='a1ca09ad7e6746aa810f73339308c9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e57966e-da45-458a-bb65-17164c1705f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e57966e-da45-458a-bb65-17164c1705f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29152da2-8bb4-4cde-998b-4f743ca217df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29152da2-8bb4-4cde-998b-4f743ca217df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd4b23b-6e13-4444-9abd-24972f73c27c', 'volume_name': 'volume-dfd4b23b-6e13-4444-9abd-24972f73c27c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2b59a6-8164-49bb-8769-1fee5314148e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2b59a6-8164-49bb-8769-1fee5314148e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f909a714-e1b3-4710-8281-f0f7eda26eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:58 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Volume dfd4b23b-6e13-4444-9abd-24972f73c27c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd4b23b-6e13-4444-9abd-24972f73c27c', 'volume_size': 1} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1720647088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd4b23b-6e13-4444-9abd-24972f73c27c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfebf3a903f44ab6b893adf641d16e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:36:58Z,use_quota=True,user_id='a1ca09ad7e6746aa810f73339308c9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Creating volume dfd4b23b-6e13-4444-9abd-24972f73c27c {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:36:58 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:58 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c 1073741824 Aug 05 10:36:58 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:58 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c 1073741824" returned: 0 in 0.461s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:36:59 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c Aug 05 10:36:59 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:36:59 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Aug 05 10:36:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c" returned: 0 in 0.263s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:36:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:36:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:36:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f909a714-e1b3-4710-8281-f0f7eda26eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd4b23b-6e13-4444-9abd-24972f73c27c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619d56fe-8615-4c5d-bc7a-f78d37c75c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:36:59 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Volume volume-dfd4b23b-6e13-4444-9abd-24972f73c27c (dfd4b23b-6e13-4444-9abd-24972f73c27c): created successfully Aug 05 10:36:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619d56fe-8615-4c5d-bc7a-f78d37c75c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:36:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Flow 'volume_create_manager' (7e45534d-9307-4786-a39f-5ee73792830a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:36:59 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1d7f2d6e-72b8-41d4-bc43-ec478af7cf95 tempest-SnapshotsActionsTest-1398978246 None] Created volume successfully. Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Flow 'volume_create_manager' (2548fe21-3022-4935-8b39-49230eed8baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554c2303-7a7b-4322-97b6-0482572ad768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554c2303-7a7b-4322-97b6-0482572ad768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2126571870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e35c2b3-5103-4d9c-9049-4791109fbb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffec884a758b45e0ab256fa60b1dde85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:37:00Z,use_quota=True,user_id='fe06f81b29d04ef096d3e3d4d0c5689a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1e4b385-87c6-48b6-a928-df6701bcbaf5),volume_type_id=f1e4b385-87c6-48b6-a928-df6701bcbaf5)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf5771c-5a7a-456e-80bc-e0bbd014ff80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf5771c-5a7a-456e-80bc-e0bbd014ff80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea8dfe0-b343-4075-bd65-c4b13ac681c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea8dfe0-b343-4075-bd65-c4b13ac681c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e35c2b3-5103-4d9c-9049-4791109fbb9b', 'volume_name': 'volume-6e35c2b3-5103-4d9c-9049-4791109fbb9b', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e0565a-99a7-4e92-87ad-daf0f342a545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e0565a-99a7-4e92-87ad-daf0f342a545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead6ebdf-3349-4fc8-a080-afdec49e3274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:00 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Volume 6e35c2b3-5103-4d9c-9049-4791109fbb9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e35c2b3-5103-4d9c-9049-4791109fbb9b', 'volume_size': 1} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2126571870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e35c2b3-5103-4d9c-9049-4791109fbb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffec884a758b45e0ab256fa60b1dde85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:37:00Z,use_quota=True,user_id='fe06f81b29d04ef096d3e3d4d0c5689a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1e4b385-87c6-48b6-a928-df6701bcbaf5),volume_type_id=f1e4b385-87c6-48b6-a928-df6701bcbaf5)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Creating volume 6e35c2b3-5103-4d9c-9049-4791109fbb9b {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:37:00 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6e35c2b3-5103-4d9c-9049-4791109fbb9b 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:00 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6e35c2b3-5103-4d9c-9049-4791109fbb9b 1073741824 Aug 05 10:37:00 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Flow 'volume_create_manager' (0dcfd250-79a3-43e3-8512-4ee336dcc110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb8c1ae-6164-4ba5-9233-3802857fe308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb8c1ae-6164-4ba5-9233-3802857fe308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-866297120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31345de8-bf52-4ff2-87b7-b8baafe468d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffec884a758b45e0ab256fa60b1dde85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:37:00Z,use_quota=True,user_id='fe06f81b29d04ef096d3e3d4d0c5689a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b305a9a8-4960-4f79-812b-391ae2889501),volume_type_id=b305a9a8-4960-4f79-812b-391ae2889501)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548eb26e-b63c-497a-9800-1ce87218baf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548eb26e-b63c-497a-9800-1ce87218baf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdab97cf-30a2-4ebf-a418-9743ba4e6e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdab97cf-30a2-4ebf-a418-9743ba4e6e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31345de8-bf52-4ff2-87b7-b8baafe468d5', 'volume_name': 'volume-31345de8-bf52-4ff2-87b7-b8baafe468d5', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76814678-8018-4b66-89d0-dd9c1f6b481a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76814678-8018-4b66-89d0-dd9c1f6b481a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493b6998-e66f-40af-ab99-4f2e5f3629d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:00 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Volume 31345de8-bf52-4ff2-87b7-b8baafe468d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31345de8-bf52-4ff2-87b7-b8baafe468d5', 'volume_size': 1} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:00 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6e35c2b3-5103-4d9c-9049-4791109fbb9b 1073741824" returned: 0 in 0.549s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6e35c2b3-5103-4d9c-9049-4791109fbb9b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:00 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6e35c2b3-5103-4d9c-9049-4791109fbb9b Aug 05 10:37:00 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:01 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6e35c2b3-5103-4d9c-9049-4791109fbb9b" returned: 0 in 0.272s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.489s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-866297120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31345de8-bf52-4ff2-87b7-b8baafe468d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffec884a758b45e0ab256fa60b1dde85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:37:00Z,use_quota=True,user_id='fe06f81b29d04ef096d3e3d4d0c5689a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b305a9a8-4960-4f79-812b-391ae2889501),volume_type_id=b305a9a8-4960-4f79-812b-391ae2889501)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Creating volume 31345de8-bf52-4ff2-87b7-b8baafe468d5 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:37:01 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-31345de8-bf52-4ff2-87b7-b8baafe468d5 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:01 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-31345de8-bf52-4ff2-87b7-b8baafe468d5 1073741824 Aug 05 10:37:01 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead6ebdf-3349-4fc8-a080-afdec49e3274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e35c2b3-5103-4d9c-9049-4791109fbb9b', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96467a64-a5a4-44eb-b097-1099f0cf779d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:01 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Volume volume-6e35c2b3-5103-4d9c-9049-4791109fbb9b (6e35c2b3-5103-4d9c-9049-4791109fbb9b): created successfully Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96467a64-a5a4-44eb-b097-1099f0cf779d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Flow 'volume_create_manager' (2548fe21-3022-4935-8b39-49230eed8baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Flow 'volume_create_manager' (c85e839d-7497-4e9e-9f90-326b0285eef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c59dee4-0a75-4ab9-b9f2-2462a5b080c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:01 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-92937582-720d-492e-9014-0429eafeb47e tempest-TestInstancesWithCinderVolumes-756925004 None] Created volume successfully. Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c59dee4-0a75-4ab9-b9f2-2462a5b080c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-843301270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402c09ea-d64c-4b3b-ba3c-f93dc4496627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffec884a758b45e0ab256fa60b1dde85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:37:01Z,use_quota=True,user_id='fe06f81b29d04ef096d3e3d4d0c5689a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24cc1221-1ae9-420e-b360-c3ea048e2ca8),volume_type_id=24cc1221-1ae9-420e-b360-c3ea048e2ca8)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50729937-68cd-4887-9c4b-312d19f7412f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50729937-68cd-4887-9c4b-312d19f7412f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22365e32-025f-4308-a585-8082cd45c8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.image.glance [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Creating Keystone auth plugin from conf {{(pid=88736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22365e32-025f-4308-a585-8082cd45c8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '402c09ea-d64c-4b3b-ba3c-f93dc4496627', 'volume_name': 'volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627', 'volume_size': 1, 'image_id': '3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--719727140', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ffec884a758b45e0ab256fa60b1dde85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe', 'created_at': datetime.datetime(2026, 8, 5, 8, 36, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 36, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe/file', 'properties': {}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37edffe5-4bea-4266-a3c5-b69192abd625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37edffe5-4bea-4266-a3c5-b69192abd625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94296d02-6081-4f98-abd3-b49f75a7ec40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:01 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:01 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Volume 402c09ea-d64c-4b3b-ba3c-f93dc4496627: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627', 'volume_size': 1, 'image_id': '3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--719727140', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ffec884a758b45e0ab256fa60b1dde85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe', 'created_at': datetime.datetime(2026, 8, 5, 8, 36, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 36, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe/file', 'properties': {}}, 'image_service': } Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Trying to clone 402c09ea-d64c-4b3b-ba3c-f93dc4496627 from image 3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe at location (None, [{'url': 'file:///opt/stack/data/glance/images/3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe', 'metadata': {}}]). {{(pid=88736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-31345de8-bf52-4ff2-87b7-b8baafe468d5 1073741824" returned: 0 in 0.475s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-31345de8-bf52-4ff2-87b7-b8baafe468d5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:01 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-31345de8-bf52-4ff2-87b7-b8baafe468d5 Aug 05 10:37:01 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:01 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-31345de8-bf52-4ff2-87b7-b8baafe468d5" returned: 0 in 0.268s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.103s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493b6998-e66f-40af-ab99-4f2e5f3629d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31345de8-bf52-4ff2-87b7-b8baafe468d5', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312895cd-89ee-4207-91a7-bc3c4d4168b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] Creating offline snapshot 1d763ee8-1fbd-44b8-bb71-50fafae32bca of volume dfd4b23b-6e13-4444-9abd-24972f73c27c {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:37:01 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Volume volume-31345de8-bf52-4ff2-87b7-b8baafe468d5 (31345de8-bf52-4ff2-87b7-b8baafe468d5): created successfully Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312895cd-89ee-4207-91a7-bc3c4d4168b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Flow 'volume_create_manager' (0dcfd250-79a3-43e3-8512-4ee336dcc110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8232b71-c809-474a-a4da-ef8d6d85418a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:01 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-fc871095-8376-4dce-92a3-8d3e324231ac tempest-TestInstancesWithCinderVolumes-756925004 None] Created volume successfully. Aug 05 10:37:02 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c Aug 05 10:37:02 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:02 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c" returned: 0 in 0.386s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:02 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca 1G Aug 05 10:37:02 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:02 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca 1G" returned: 0 in 0.416s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd4b23b-6e13-4444-9abd-24972f73c27c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:02 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd4b23b-6e13-4444-9abd-24972f73c27c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca Aug 05 10:37:02 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:03 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd4b23b-6e13-4444-9abd-24972f73c27c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca" returned: 0 in 0.290s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:03 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca is being set with open permissions: ugo+rw Aug 05 10:37:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:03 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca Aug 05 10:37:03 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:03 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca" returned: 0 in 0.254s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:03 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.info Aug 05 10:37:03 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:03 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.info" returned: 0 in 0.246s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:03 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.info is being set with open permissions: ugo+rw Aug 05 10:37:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:03 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.info Aug 05 10:37:03 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:03 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.info" returned: 0 in 0.259s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:03 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-56d7e576-a3f9-4af3-9252-1d39365a6fe4 tempest-SnapshotsActionsTest-1398978246 None] Create snapshot completed successfully Aug 05 10:37:04 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_1ol3uh42devstack@QuobyteHD, size 20.69 MB, duration 3.21 sec {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:37:04 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Image download 20.69 MB at 6.43 MB/s Aug 05 10:37:04 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[35474a80-c9bb-4491-a794-dcd5b31591ee]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_1ol3uh42devstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:04 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_1ol3uh42devstack@QuobyteHD Aug 05 10:37:04 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:05 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_1ol3uh42devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:05 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Temporary image 3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe is fetched for user fe06f81b29d04ef096d3e3d4d0c5689a. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:37:05 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fcd186-17d8-453b-b44e-da5a1c6af911]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_1ol3uh42devstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:05 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_1ol3uh42devstack@QuobyteHD Aug 05 10:37:05 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f427a6bf-2fda-41fb-a8b1-ca12d487f0b3 tempest-SnapshotsActionsTest-1398978246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f427a6bf-2fda-41fb-a8b1-ca12d487f0b3 tempest-SnapshotsActionsTest-1398978246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-f427a6bf-2fda-41fb-a8b1-ca12d487f0b3 tempest-SnapshotsActionsTest-1398978246 None] Creating offline snapshot 6f6b47a4-b776-44e4-a567-5f538676e90c of volume dfd4b23b-6e13-4444-9abd-24972f73c27c {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:37:05 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de32b86-9a3b-4488-a2fd-87428df594bc]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f427a6bf-2fda-41fb-a8b1-ca12d487f0b3 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:05 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_1ol3uh42devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:05 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca Aug 05 10:37:05 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:05 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f427a6bf-2fda-41fb-a8b1-ca12d487f0b3 tempest-SnapshotsActionsTest-1398978246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca" returned: 0 in 0.362s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-f427a6bf-2fda-41fb-a8b1-ca12d487f0b3 tempest-SnapshotsActionsTest-1398978246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfd4b23b-6e13-4444-9abd-24972f73c27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:37:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f427a6bf-2fda-41fb-a8b1-ca12d487f0b3 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:05 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c 1G Aug 05 10:37:05 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:06 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f427a6bf-2fda-41fb-a8b1-ca12d487f0b3 tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c 1G" returned: 0 in 0.401s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f427a6bf-2fda-41fb-a8b1-ca12d487f0b3 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:06 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c Aug 05 10:37:06 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:06 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f427a6bf-2fda-41fb-a8b1-ca12d487f0b3 tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c" returned: 0 in 0.272s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:06 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-f427a6bf-2fda-41fb-a8b1-ca12d487f0b3 tempest-SnapshotsActionsTest-1398978246 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c is being set with open permissions: ugo+rw Aug 05 10:37:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f427a6bf-2fda-41fb-a8b1-ca12d487f0b3 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:06 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c Aug 05 10:37:06 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:06 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f427a6bf-2fda-41fb-a8b1-ca12d487f0b3 tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c" returned: 0 in 0.232s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f427a6bf-2fda-41fb-a8b1-ca12d487f0b3 tempest-SnapshotsActionsTest-1398978246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.358s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.196s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-843301270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402c09ea-d64c-4b3b-ba3c-f93dc4496627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffec884a758b45e0ab256fa60b1dde85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:37:01Z,use_quota=True,user_id='fe06f81b29d04ef096d3e3d4d0c5689a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24cc1221-1ae9-420e-b360-c3ea048e2ca8),volume_type_id=24cc1221-1ae9-420e-b360-c3ea048e2ca8)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:37:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Creating volume 402c09ea-d64c-4b3b-ba3c-f93dc4496627 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:37:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:37:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:37:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:37:06 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:37:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:06 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627 1073741824 Aug 05 10:37:06 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:06 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-f427a6bf-2fda-41fb-a8b1-ca12d487f0b3 tempest-SnapshotsActionsTest-1398978246 None] Create snapshot completed successfully Aug 05 10:37:07 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627 1073741824" returned: 0 in 0.391s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:07 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627 Aug 05 10:37:07 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:07 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627" returned: 0 in 0.242s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Attempting download of 3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe ((None, [{'url': 'file:///opt/stack/data/glance/images/3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe', 'metadata': {}}])) to volume 402c09ea-d64c-4b3b-ba3c-f93dc4496627. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5331796-bfe9-47da-8539-ed5bf49b49ef]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_56uavays {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Acquiring lock "cinder-6f6b47a4-b776-44e4-a567-5f538676e90c-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:07 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_56uavays Aug 05 10:37:07 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-6f6b47a4-b776-44e4-a567-5f538676e90c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Acquiring lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Acquiring lock "cinder-quobyte-6f6b47a4-b776-44e4-a567-5f538676e90c" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-quobyte-6f6b47a4-b776-44e4-a567-5f538676e90c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Deleting offline snapshot 6f6b47a4-b776-44e4-a567-5f538676e90c of volume dfd4b23b-6e13-4444-9abd-24972f73c27c {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] snapshot_file for this snap is: volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf6fe55-5828-4948-88d5-cf3e61a14501]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:07 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c Aug 05 10:37:07 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:07 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_56uavays" returned: 0 in 0.335s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_56uavays {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:07 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_56uavays Aug 05 10:37:07 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:08 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c" returned: 0 in 0.354s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfd4b23b-6e13-4444-9abd-24972f73c27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:37:08 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d7e85f-76a6-49d1-bc17-705100d989b3]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:08 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_56uavays" returned: 1 in 0.322s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_56uavays' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:37:08 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4542cc-bb68-44ba-baa4-828aef4b7770]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_1ol3uh42devstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:08 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca Aug 05 10:37:08 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:08 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_1ol3uh42devstack@QuobyteHD Aug 05 10:37:08 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:08 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca" returned: 0 in 0.374s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfd4b23b-6e13-4444-9abd-24972f73c27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:37:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:08 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c Aug 05 10:37:08 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:08 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_1ol3uh42devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:08 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] 3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe was qcow2, converting to qcow2 {{(pid=88736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:37:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_1ol3uh42devstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:08 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_1ol3uh42devstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627 Aug 05 10:37:08 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:08 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c" returned: 0 in 0.411s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:08 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c Aug 05 10:37:08 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:09 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.6f6b47a4-b776-44e4-a567-5f538676e90c" returned: 0 in 0.269s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-quobyte-6f6b47a4-b776-44e4-a567-5f538676e90c" released by "_delete_snapshot" :: held 1.496s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" released by "delete_snapshot" :: held 1.518s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:09 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Created reservations ['ca7670a2-807f-4e94-96e6-231488908f3e', '31f3249c-8267-403e-8dc6-415999fc35ec', '54fa8ab8-671f-49f2-a748-d0d3f0ca1e95', '0b3433f9-c66e-4347-af66-d4d16b8b7023'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:37:09 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Delete snapshot completed successfully. Aug 05 10:37:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00dc9da3-c2b4-4397-8eb6-274012ee0115 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-6f6b47a4-b776-44e4-a567-5f538676e90c-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3ed79681-3a55-487f-8ff4-7b535f7aea4b tempest-SnapshotsActionsTest-1398978246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3ed79681-3a55-487f-8ff4-7b535f7aea4b tempest-SnapshotsActionsTest-1398978246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-3ed79681-3a55-487f-8ff4-7b535f7aea4b tempest-SnapshotsActionsTest-1398978246 None] Creating offline snapshot aff7f157-5ca4-4557-a40b-37f935786b64 of volume dfd4b23b-6e13-4444-9abd-24972f73c27c {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[26694197-756a-4529-ab47-e558f3616719]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ed79681-3a55-487f-8ff4-7b535f7aea4b tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:10 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_1ol3uh42devstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627" returned: 0 in 1.691s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe_1ol3uh42devstack@QuobyteHD, size 112.00 MB, duration 1.69 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627 {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:37:10 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Converted 112.00 MB image at 66.18 MB/s Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:10 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627 1G Aug 05 10:37:10 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:10 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca Aug 05 10:37:10 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:10 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:10 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627 1G" returned: 0 in 0.325s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ed79681-3a55-487f-8ff4-7b535f7aea4b tempest-SnapshotsActionsTest-1398978246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca" returned: 0 in 0.376s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Downloaded image 3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe ((None, [{'url': 'file:///opt/stack/data/glance/images/3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe', 'metadata': {}}])) to volume 402c09ea-d64c-4b3b-ba3c-f93dc4496627 successfully. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Temporary image 3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe for user fe06f81b29d04ef096d3e3d4d0c5689a is deleted. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Marking volume 402c09ea-d64c-4b3b-ba3c-f93dc4496627 as bootable. {{(pid=88736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-3ed79681-3a55-487f-8ff4-7b535f7aea4b tempest-SnapshotsActionsTest-1398978246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfd4b23b-6e13-4444-9abd-24972f73c27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ed79681-3a55-487f-8ff4-7b535f7aea4b tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Copying metadata from image 3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe to 402c09ea-d64c-4b3b-ba3c-f93dc4496627. {{(pid=88736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Creating volume glance metadata for volume 402c09ea-d64c-4b3b-ba3c-f93dc4496627 backed by image 3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe with: {'image_id': '3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe', 'image_name': 'tempest-scenario-img--719727140', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:37:10 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64 1G Aug 05 10:37:10 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94296d02-6081-4f98-abd3-b49f75a7ec40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627', 'volume_size': 1, 'image_id': '3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--719727140', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ffec884a758b45e0ab256fa60b1dde85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe', 'created_at': datetime.datetime(2026, 8, 5, 8, 36, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 36, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ed01ded-fdcb-4d70-a8fe-6d6773d4a3fe/file', 'properties': {}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a3c6c8-b9b0-41d4-8a9b-added6f21b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:10 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Volume volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627 (402c09ea-d64c-4b3b-ba3c-f93dc4496627): created successfully Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a3c6c8-b9b0-41d4-8a9b-added6f21b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Flow 'volume_create_manager' (c85e839d-7497-4e9e-9f90-326b0285eef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:37:10 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-5e3c60fc-030f-4755-85fa-58f9d6d0f6fd tempest-TestInstancesWithCinderVolumes-756925004 None] Created volume successfully. Aug 05 10:37:10 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ed79681-3a55-487f-8ff4-7b535f7aea4b tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64 1G" returned: 0 in 0.433s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ed79681-3a55-487f-8ff4-7b535f7aea4b tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:10 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64 Aug 05 10:37:10 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:11 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ed79681-3a55-487f-8ff4-7b535f7aea4b tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64" returned: 0 in 0.273s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:11 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-3ed79681-3a55-487f-8ff4-7b535f7aea4b tempest-SnapshotsActionsTest-1398978246 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64 is being set with open permissions: ugo+rw Aug 05 10:37:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ed79681-3a55-487f-8ff4-7b535f7aea4b tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:11 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64 Aug 05 10:37:11 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:11 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ed79681-3a55-487f-8ff4-7b535f7aea4b tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64" returned: 0 in 0.247s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3ed79681-3a55-487f-8ff4-7b535f7aea4b tempest-SnapshotsActionsTest-1398978246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.451s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:11 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-3ed79681-3a55-487f-8ff4-7b535f7aea4b tempest-SnapshotsActionsTest-1398978246 None] Create snapshot completed successfully Aug 05 10:37:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Acquiring lock "cinder-aff7f157-5ca4-4557-a40b-37f935786b64-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-aff7f157-5ca4-4557-a40b-37f935786b64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Acquiring lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Acquiring lock "cinder-quobyte-aff7f157-5ca4-4557-a40b-37f935786b64" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-quobyte-aff7f157-5ca4-4557-a40b-37f935786b64" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Deleting offline snapshot aff7f157-5ca4-4557-a40b-37f935786b64 of volume dfd4b23b-6e13-4444-9abd-24972f73c27c {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:37:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] snapshot_file for this snap is: volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:37:12 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10d61e8-7bd9-42c9-8fd9-b516269b759c]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:12 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64 Aug 05 10:37:12 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:12 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64" returned: 0 in 0.381s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfd4b23b-6e13-4444-9abd-24972f73c27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:37:12 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[078bf0a4-d8b4-42af-b9de-daf52304a502]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:12 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca Aug 05 10:37:12 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:13 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca" returned: 0 in 0.388s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfd4b23b-6e13-4444-9abd-24972f73c27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:37:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:13 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64 Aug 05 10:37:13 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:13 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64" returned: 0 in 0.386s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:13 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64 Aug 05 10:37:13 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:13 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.aff7f157-5ca4-4557-a40b-37f935786b64" returned: 0 in 0.262s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-quobyte-aff7f157-5ca4-4557-a40b-37f935786b64" released by "_delete_snapshot" :: held 1.514s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" released by "delete_snapshot" :: held 1.536s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:37:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:37:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:37:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:13 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:37:13 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:13 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Created reservations ['f26946d5-8893-434b-8e7b-b15f0d912202', '08558749-d737-47e8-9e54-5cdf242aaaf7', '052e02d3-f305-47d4-82d3-4bfa325f7a1f', 'ad3d9db4-3aeb-4648-9f50-01a3d5695597'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:37:14 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Delete snapshot completed successfully. Aug 05 10:37:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e03df938-6733-455c-a3a2-931449150f3f tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-aff7f157-5ca4-4557-a40b-37f935786b64-delete_snapshot" released by "delete_snapshot" :: held 1.734s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:14 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.337s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:37:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:37:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:37:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:37:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-58a87119-a21b-432c-985a-a29e939824df req-3eedcde2-b2b8-47b1-befb-18d4b943c46a tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-58a87119-a21b-432c-985a-a29e939824df req-3eedcde2-b2b8-47b1-befb-18d4b943c46a tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-58a87119-a21b-432c-985a-a29e939824df req-3eedcde2-b2b8-47b1-befb-18d4b943c46a tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-58a87119-a21b-432c-985a-a29e939824df req-3eedcde2-b2b8-47b1-befb-18d4b943c46a tempest-TestInstancesWithCinderVolumes-756925004 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c547d580-81b4-428a-bc07-210b72c5f397', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:37:14 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-58a87119-a21b-432c-985a-a29e939824df req-3eedcde2-b2b8-47b1-befb-18d4b943c46a tempest-TestInstancesWithCinderVolumes-756925004 None] attachment_update completed successfully. Aug 05 10:37:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-66b26751-ca6c-4e2f-8fd0-278b005007dd tempest-SnapshotsActionsTest-1398978246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-66b26751-ca6c-4e2f-8fd0-278b005007dd tempest-SnapshotsActionsTest-1398978246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-66b26751-ca6c-4e2f-8fd0-278b005007dd tempest-SnapshotsActionsTest-1398978246 None] Creating offline snapshot 1c473b71-c266-45f5-94a4-20ad0befb811 of volume dfd4b23b-6e13-4444-9abd-24972f73c27c {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:37:14 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[33717553-3bc3-4209-8dd4-864faded76b2]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-66b26751-ca6c-4e2f-8fd0-278b005007dd tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:15 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca Aug 05 10:37:15 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:15 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-66b26751-ca6c-4e2f-8fd0-278b005007dd tempest-SnapshotsActionsTest-1398978246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca" returned: 0 in 0.368s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-66b26751-ca6c-4e2f-8fd0-278b005007dd tempest-SnapshotsActionsTest-1398978246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfd4b23b-6e13-4444-9abd-24972f73c27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:37:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-66b26751-ca6c-4e2f-8fd0-278b005007dd tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:15 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811 1G Aug 05 10:37:15 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:15 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-66b26751-ca6c-4e2f-8fd0-278b005007dd tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811 1G" returned: 0 in 0.464s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-66b26751-ca6c-4e2f-8fd0-278b005007dd tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:15 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811 Aug 05 10:37:15 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:16 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-66b26751-ca6c-4e2f-8fd0-278b005007dd tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811" returned: 0 in 0.299s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:16 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-66b26751-ca6c-4e2f-8fd0-278b005007dd tempest-SnapshotsActionsTest-1398978246 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811 is being set with open permissions: ugo+rw Aug 05 10:37:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-66b26751-ca6c-4e2f-8fd0-278b005007dd tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:16 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811 Aug 05 10:37:16 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:16 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-66b26751-ca6c-4e2f-8fd0-278b005007dd tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811" returned: 0 in 0.254s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-66b26751-ca6c-4e2f-8fd0-278b005007dd tempest-SnapshotsActionsTest-1398978246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.548s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:16 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-66b26751-ca6c-4e2f-8fd0-278b005007dd tempest-SnapshotsActionsTest-1398978246 None] Create snapshot completed successfully Aug 05 10:37:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Acquiring lock "cinder-1c473b71-c266-45f5-94a4-20ad0befb811-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-1c473b71-c266-45f5-94a4-20ad0befb811-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Acquiring lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Acquiring lock "cinder-quobyte-1c473b71-c266-45f5-94a4-20ad0befb811" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-quobyte-1c473b71-c266-45f5-94a4-20ad0befb811" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Deleting offline snapshot 1c473b71-c266-45f5-94a4-20ad0befb811 of volume dfd4b23b-6e13-4444-9abd-24972f73c27c {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:37:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] snapshot_file for this snap is: volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:37:17 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea65534-bac2-4e67-b153-dbfb38e19d07]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:17 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811 Aug 05 10:37:17 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:17 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811" returned: 0 in 0.473s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfd4b23b-6e13-4444-9abd-24972f73c27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:37:17 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf97afc-265c-4bb0-a12b-97def2fcf396]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:17 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca Aug 05 10:37:17 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:18 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca" returned: 0 in 0.395s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfd4b23b-6e13-4444-9abd-24972f73c27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:37:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:18 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811 Aug 05 10:37:18 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:18 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811" returned: 0 in 0.379s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:18 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811 Aug 05 10:37:18 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:18 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1c473b71-c266-45f5-94a4-20ad0befb811" returned: 0 in 0.257s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-quobyte-1c473b71-c266-45f5-94a4-20ad0befb811" released by "_delete_snapshot" :: held 1.622s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" released by "delete_snapshot" :: held 1.649s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:18 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Created reservations ['540ba746-48ae-4ae7-add3-9f593bdfa8a4', '155a7ba7-d287-4399-b2b6-d337089cafcc', '9ec48995-7a38-4d49-bc5c-71f0474a5b76', '1d8d7e38-d01a-4b78-a3af-a123c6eaa184'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:37:19 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Delete snapshot completed successfully. Aug 05 10:37:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a4d1dc96-5ac9-4a0c-8bc1-1881f125af70 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-1c473b71-c266-45f5-94a4-20ad0befb811-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-95b2bbb3-c490-41a9-91a7-a65228c999b0 tempest-SnapshotsActionsTest-1398978246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-95b2bbb3-c490-41a9-91a7-a65228c999b0 tempest-SnapshotsActionsTest-1398978246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-95b2bbb3-c490-41a9-91a7-a65228c999b0 tempest-SnapshotsActionsTest-1398978246 None] Creating offline snapshot 8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359 of volume dfd4b23b-6e13-4444-9abd-24972f73c27c {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:37:19 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[73751371-3df8-493b-9ea5-12e1daaaba2a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-95b2bbb3-c490-41a9-91a7-a65228c999b0 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:20 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca Aug 05 10:37:20 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:20 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-95b2bbb3-c490-41a9-91a7-a65228c999b0 tempest-SnapshotsActionsTest-1398978246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca" returned: 0 in 0.383s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:20 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-95b2bbb3-c490-41a9-91a7-a65228c999b0 tempest-SnapshotsActionsTest-1398978246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfd4b23b-6e13-4444-9abd-24972f73c27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:37:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-95b2bbb3-c490-41a9-91a7-a65228c999b0 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:20 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359 1G Aug 05 10:37:20 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:20 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-95b2bbb3-c490-41a9-91a7-a65228c999b0 tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359 1G" returned: 0 in 0.436s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-95b2bbb3-c490-41a9-91a7-a65228c999b0 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:20 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359 Aug 05 10:37:20 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:21 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-95b2bbb3-c490-41a9-91a7-a65228c999b0 tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359" returned: 0 in 0.304s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:21 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-95b2bbb3-c490-41a9-91a7-a65228c999b0 tempest-SnapshotsActionsTest-1398978246 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359 is being set with open permissions: ugo+rw Aug 05 10:37:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-95b2bbb3-c490-41a9-91a7-a65228c999b0 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:21 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359 Aug 05 10:37:21 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:21 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-95b2bbb3-c490-41a9-91a7-a65228c999b0 tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359" returned: 0 in 0.262s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-95b2bbb3-c490-41a9-91a7-a65228c999b0 tempest-SnapshotsActionsTest-1398978246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.493s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:21 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-95b2bbb3-c490-41a9-91a7-a65228c999b0 tempest-SnapshotsActionsTest-1398978246 None] Create snapshot completed successfully Aug 05 10:37:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Acquiring lock "cinder-8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Acquiring lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Acquiring lock "cinder-quobyte-8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-quobyte-8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Deleting offline snapshot 8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359 of volume dfd4b23b-6e13-4444-9abd-24972f73c27c {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:37:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] snapshot_file for this snap is: volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:37:22 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[097223ee-7a5b-47a2-b211-ffd7f019c327]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:22 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359 Aug 05 10:37:22 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:22 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359" returned: 0 in 0.452s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfd4b23b-6e13-4444-9abd-24972f73c27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:37:22 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[19023188-8643-4d7f-b64b-fd9a20e254d6]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:22 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca Aug 05 10:37:22 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:23 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca" returned: 0 in 0.482s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfd4b23b-6e13-4444-9abd-24972f73c27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:37:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:23 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359 Aug 05 10:37:23 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:23 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359" returned: 0 in 0.498s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:23 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359 Aug 05 10:37:23 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:24 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359" returned: 0 in 0.336s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-quobyte-8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359" released by "_delete_snapshot" :: held 1.894s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" released by "delete_snapshot" :: held 1.931s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:24 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Created reservations ['3e2a0590-98a4-4f7d-8b80-13562dfb0167', '7a0b5c90-cf1e-40c8-b95d-972eced91e21', 'beaddbc5-3c4d-47b2-87b2-9933d3ca0254', '683b9067-5635-4e11-b95c-d6be6f6edeaa'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:37:24 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Delete snapshot completed successfully. Aug 05 10:37:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-86197a7e-67f9-4aef-ba8d-06b9de0c3b56 tempest-SnapshotsActionsTest-1849985271 None] Lock "cinder-8ca8ef18-3c6f-40e9-b2a3-97ba8b26a359-delete_snapshot" released by "delete_snapshot" :: held 2.167s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] Acquiring lock "cinder-1d763ee8-1fbd-44b8-bb71-50fafae32bca-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] Lock "cinder-1d763ee8-1fbd-44b8-bb71-50fafae32bca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] Acquiring lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] Lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] Acquiring lock "cinder-quobyte-1d763ee8-1fbd-44b8-bb71-50fafae32bca" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] Lock "cinder-quobyte-1d763ee8-1fbd-44b8-bb71-50fafae32bca" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] Deleting offline snapshot 1d763ee8-1fbd-44b8-bb71-50fafae32bca of volume dfd4b23b-6e13-4444-9abd-24972f73c27c {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:37:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] snapshot_file for this snap is: volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:37:24 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7958a598-8b90-42d6-aa87-7bb343c96c75]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:25 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca Aug 05 10:37:25 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:25 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca" returned: 0 in 0.428s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfd4b23b-6e13-4444-9abd-24972f73c27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:37:25 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eacaddf-67c5-4396-a191-2eca37c4c7f8]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:25 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c Aug 05 10:37:25 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:25 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c" returned: 0 in 0.422s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:25 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca Aug 05 10:37:25 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:26 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca" returned: 0 in 0.386s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:26 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca Aug 05 10:37:26 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:26 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c.1d763ee8-1fbd-44b8-bb71-50fafae32bca" returned: 0 in 0.249s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] Lock "cinder-quobyte-1d763ee8-1fbd-44b8-bb71-50fafae32bca" released by "_delete_snapshot" :: held 1.612s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] Lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" released by "delete_snapshot" :: held 1.646s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:26 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] Created reservations ['59b0b396-a3ed-41bc-96a9-6629dabc7d11', '92a84472-4287-4029-9e65-973963b00e8e', 'dd9ae10e-b173-4f08-a8cd-03f334188b97', 'a1b5b2eb-dca0-473d-996e-396768e59b5e'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:37:26 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] Delete snapshot completed successfully. Aug 05 10:37:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a9aecaf6-8235-43fa-a4d1-fcf4086a14dc tempest-SnapshotsActionsTest-1398978246 None] Lock "cinder-1d763ee8-1fbd-44b8-bb71-50fafae32bca-delete_snapshot" released by "delete_snapshot" :: held 1.792s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] Acquiring lock "cinder-dfd4b23b-6e13-4444-9abd-24972f73c27c-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] Lock "cinder-dfd4b23b-6e13-4444-9abd-24972f73c27c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] Acquiring lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] Lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" acquired by "delete_volume" :: waited 0.024s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:27 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[343daf6e-975f-48e8-aff4-3b322692b8b3]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:27 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c Aug 05 10:37:27 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:27 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c" returned: 0 in 0.404s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:27 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c Aug 05 10:37:27 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:27 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dfd4b23b-6e13-4444-9abd-24972f73c27c" returned: 0 in 0.259s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] Lock "cinder-quobyte-dfd4b23b-6e13-4444-9abd-24972f73c27c" released by "delete_volume" :: held 0.721s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:28 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] Created reservations ['342c17b8-90c1-4c2a-b730-7833700a80fd', '1c1a50ac-a2e9-4f09-8964-55d576460a01', '081163b3-1b78-438c-9b67-19d3c297e7cf', '59f27229-00e9-438d-87a5-04ed97052506'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:37:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:37:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:37:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:28 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:37:28 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:28 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.258s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:28 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:37:28 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] Deleted volume successfully. Aug 05 10:37:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b7a298ad-0d69-4ce5-8739-0d1405b09406 tempest-SnapshotsActionsTest-1398978246 None] Lock "cinder-dfd4b23b-6e13-4444-9abd-24972f73c27c-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=52,cinder:UPDATE=62,cinder:DELETE=5,cinder:INSERT=20 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:UPDATE=50,cinder:SELECT=72,cinder:INSERT=18,cinder:DELETE=5 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Flow 'volume_create_manager' (07d1efe0-77f9-4fef-8fb2-e46b2833f367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468d740a-5aa2-4bbd-98c2-38b14f187902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468d740a-5aa2-4bbd-98c2-38b14f187902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1309487740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886ac96d-b168-4aec-b041-839407d28206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4354c9f6a01f434d8dac94cea6e6e038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:37:39Z,use_quota=True,user_id='f4636d8414c14f06a4b8af0b4743a4d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b60c506-fd67-485c-8f85-bb9e0e47bf3e),volume_type_id=4b60c506-fd67-485c-8f85-bb9e0e47bf3e)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262abb4f-ec25-4740-b743-e7dd946a4292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262abb4f-ec25-4740-b743-e7dd946a4292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1d8aeb-b4dc-4b7e-a41f-cf95ec20d183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1d8aeb-b4dc-4b7e-a41f-cf95ec20d183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '886ac96d-b168-4aec-b041-839407d28206', 'volume_name': 'volume-886ac96d-b168-4aec-b041-839407d28206', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecedc87-3f5d-496a-9f6f-b9be2b308653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecedc87-3f5d-496a-9f6f-b9be2b308653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5268f44-dc96-4f05-ae4d-8a8bc060800f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:38 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Volume 886ac96d-b168-4aec-b041-839407d28206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-886ac96d-b168-4aec-b041-839407d28206', 'volume_size': 1} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1309487740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886ac96d-b168-4aec-b041-839407d28206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4354c9f6a01f434d8dac94cea6e6e038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:37:39Z,use_quota=True,user_id='f4636d8414c14f06a4b8af0b4743a4d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b60c506-fd67-485c-8f85-bb9e0e47bf3e),volume_type_id=4b60c506-fd67-485c-8f85-bb9e0e47bf3e)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Creating volume 886ac96d-b168-4aec-b041-839407d28206 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:37:38 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:37:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-886ac96d-b168-4aec-b041-839407d28206 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:38 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-886ac96d-b168-4aec-b041-839407d28206 1073741824 Aug 05 10:37:38 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:39 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-886ac96d-b168-4aec-b041-839407d28206 1073741824" returned: 0 in 0.389s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-886ac96d-b168-4aec-b041-839407d28206 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:39 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-886ac96d-b168-4aec-b041-839407d28206 Aug 05 10:37:39 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:39 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-886ac96d-b168-4aec-b041-839407d28206" returned: 0 in 0.243s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:37:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5268f44-dc96-4f05-ae4d-8a8bc060800f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-886ac96d-b168-4aec-b041-839407d28206', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bca997-ee6e-4fda-a9a2-d821f5c8378b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:39 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Volume volume-886ac96d-b168-4aec-b041-839407d28206 (886ac96d-b168-4aec-b041-839407d28206): created successfully Aug 05 10:37:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bca997-ee6e-4fda-a9a2-d821f5c8378b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Flow 'volume_create_manager' (07d1efe0-77f9-4fef-8fb2-e46b2833f367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:37:39 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c76e7fa9-cc38-4201-8f98-19cb87b67b4b tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Created volume successfully. Aug 05 10:37:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f5612590-46fb-4ec1-986a-17f6bba42bac tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f5612590-46fb-4ec1-986a-17f6bba42bac tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f5612590-46fb-4ec1-986a-17f6bba42bac tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:37:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f5612590-46fb-4ec1-986a-17f6bba42bac tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:37:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f5612590-46fb-4ec1-986a-17f6bba42bac tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f5612590-46fb-4ec1-986a-17f6bba42bac tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:40 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:37:40 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:40 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f5612590-46fb-4ec1-986a-17f6bba42bac tempest-VolumeRetypeWithoutMigrationTest-444108460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.245s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:40 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-f5612590-46fb-4ec1-986a-17f6bba42bac tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:37:40 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-f5612590-46fb-4ec1-986a-17f6bba42bac tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Retype volume completed successfully. Aug 05 10:37:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Acquiring lock "cinder-886ac96d-b168-4aec-b041-839407d28206-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Lock "cinder-886ac96d-b168-4aec-b041-839407d28206-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Acquiring lock "cinder-quobyte-886ac96d-b168-4aec-b041-839407d28206" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Lock "cinder-quobyte-886ac96d-b168-4aec-b041-839407d28206" acquired by "delete_volume" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:41 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6c602a-85a5-49f0-8fce-13bf4aaa46d5]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-886ac96d-b168-4aec-b041-839407d28206 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:41 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-886ac96d-b168-4aec-b041-839407d28206 Aug 05 10:37:41 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:41 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-886ac96d-b168-4aec-b041-839407d28206" returned: 0 in 0.383s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-886ac96d-b168-4aec-b041-839407d28206 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:41 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-886ac96d-b168-4aec-b041-839407d28206 Aug 05 10:37:41 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:42 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-886ac96d-b168-4aec-b041-839407d28206" returned: 0 in 0.265s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Lock "cinder-quobyte-886ac96d-b168-4aec-b041-839407d28206" released by "delete_volume" :: held 0.692s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:42 devstack cinder-volume[88736]: WARNING cinder.quota [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:37:42 devstack cinder-volume[88736]: WARNING cinder.quota [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:37:42 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Created reservations ['824fd603-b961-4d27-8f13-631e5f49bf07', 'a2789d32-eff6-4c44-971b-108ffef82cd4', 'cab33c33-886e-497c-af28-bd8023284668', '2113f661-dd06-414a-8061-91b0cfe643d3'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:37:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:37:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:37:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:42 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:37:42 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:42 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.254s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:42 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:37:42 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Deleted volume successfully. Aug 05 10:37:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9ccebcf3-a4f8-44af-931b-5a0b02980386 tempest-VolumeRetypeWithoutMigrationTest-444108460 None] Lock "cinder-886ac96d-b168-4aec-b041-839407d28206-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-0f52155b-d2cd-4ea3-9acf-e6a050923b70 req-47cf8f08-7c7c-4162-91d2-110959245ccd tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-0f52155b-d2cd-4ea3-9acf-e6a050923b70 req-47cf8f08-7c7c-4162-91d2-110959245ccd tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-0f52155b-d2cd-4ea3-9acf-e6a050923b70 req-47cf8f08-7c7c-4162-91d2-110959245ccd tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-0f52155b-d2cd-4ea3-9acf-e6a050923b70 req-47cf8f08-7c7c-4162-91d2-110959245ccd tempest-TestInstancesWithCinderVolumes-756925004 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-6e35c2b3-5103-4d9c-9049-4791109fbb9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf10fc7f-1b4e-4664-af4c-a79aa6b49043', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:37:48 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-0f52155b-d2cd-4ea3-9acf-e6a050923b70 req-47cf8f08-7c7c-4162-91d2-110959245ccd tempest-TestInstancesWithCinderVolumes-756925004 None] attachment_update completed successfully. Aug 05 10:37:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-0352df1d-7ca5-404f-8325-d96986076f65 req-efe91d19-1aed-490b-8f2f-3461e593fdad tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-0352df1d-7ca5-404f-8325-d96986076f65 req-efe91d19-1aed-490b-8f2f-3461e593fdad tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-0352df1d-7ca5-404f-8325-d96986076f65 req-efe91d19-1aed-490b-8f2f-3461e593fdad tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-0352df1d-7ca5-404f-8325-d96986076f65 req-efe91d19-1aed-490b-8f2f-3461e593fdad tempest-TestInstancesWithCinderVolumes-756925004 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-31345de8-bf52-4ff2-87b7-b8baafe468d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3911953b-6066-4133-90c6-abb4a0477613', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:37:51 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-0352df1d-7ca5-404f-8325-d96986076f65 req-efe91d19-1aed-490b-8f2f-3461e593fdad tempest-TestInstancesWithCinderVolumes-756925004 None] attachment_update completed successfully. Aug 05 10:37:56 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-9cdf9f50-b507-4e55-88a3-1a606c0c764e req-7ef0118a-f8e5-479b-80fa-582c8277bf4b tempest-TestInstancesWithCinderVolumes-756925004 None] Terminate volume connection completed successfully. Aug 05 10:37:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-9cdf9f50-b507-4e55-88a3-1a606c0c764e req-7ef0118a-f8e5-479b-80fa-582c8277bf4b tempest-TestInstancesWithCinderVolumes-756925004 None] Deleting attachment bf10fc7f-1b4e-4664-af4c-a79aa6b49043. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:37:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "cinder-6e35c2b3-5103-4d9c-9049-4791109fbb9b-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "cinder-6e35c2b3-5103-4d9c-9049-4791109fbb9b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "cinder-quobyte-6e35c2b3-5103-4d9c-9049-4791109fbb9b" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:37:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "cinder-quobyte-6e35c2b3-5103-4d9c-9049-4791109fbb9b" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:37:56 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58e340f-a5f8-477b-875c-18cb45bb4eb9]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6e35c2b3-5103-4d9c-9049-4791109fbb9b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:57 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6e35c2b3-5103-4d9c-9049-4791109fbb9b Aug 05 10:37:57 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Flow 'volume_create_manager' (6930b720-8fa5-42d8-9598-f4a411a7e771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (accd0cdd-cbd5-42f9-a153-95863afe05ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (accd0cdd-cbd5-42f9-a153-95863afe05ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-124988330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0f141c-b526-44a0-8ff1-cdafdf60d534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e26d90b629840d98fc0cda821db4663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:37:57Z,use_quota=True,user_id='3b8c54094ee24762809b2c26a7e475ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc3ac17-ebf7-42d8-97d8-b7866fb2384a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc3ac17-ebf7-42d8-97d8-b7866fb2384a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2babd4f4-cfd7-4056-aa16-7bb73c8085bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.image.glance [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Creating Keystone auth plugin from conf {{(pid=88736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:37:57 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6e35c2b3-5103-4d9c-9049-4791109fbb9b" returned: 0 in 0.414s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6e35c2b3-5103-4d9c-9049-4791109fbb9b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:57 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6e35c2b3-5103-4d9c-9049-4791109fbb9b Aug 05 10:37:57 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2babd4f4-cfd7-4056-aa16-7bb73c8085bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd0f141c-b526-44a0-8ff1-cdafdf60d534', 'volume_name': 'volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534', 'volume_size': 1, 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73179855073b4e3ea3fba8cb6e296bd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/619f1530-41da-4b56-a554-65c809c7c1ea/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a928e6f8-c76c-47ea-9f81-4060cadcb595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a928e6f8-c76c-47ea-9f81-4060cadcb595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a9dba9-3618-44be-bc23-a9765a4913db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:37:57 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Volume fd0f141c-b526-44a0-8ff1-cdafdf60d534: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534', 'volume_size': 1, 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73179855073b4e3ea3fba8cb6e296bd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/619f1530-41da-4b56-a554-65c809c7c1ea/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Trying to clone fd0f141c-b526-44a0-8ff1-cdafdf60d534 from image 619f1530-41da-4b56-a554-65c809c7c1ea at location (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]). {{(pid=88736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:37:57 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6e35c2b3-5103-4d9c-9049-4791109fbb9b" returned: 0 in 0.276s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "cinder-quobyte-6e35c2b3-5103-4d9c-9049-4791109fbb9b" released by "delete_volume" :: held 0.764s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:57 devstack cinder-volume[88736]: WARNING cinder.quota [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1458874407-860472322 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1458874407-860472322, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:37:57 devstack cinder-volume[88736]: WARNING cinder.quota [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1458874407-860472322 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1458874407-860472322, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_mj7ushsfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:37:57 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Image download 20.69 MB at 20.69 MB/s Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Created reservations ['1b578b2e-4c49-4657-a8a7-c94786f4594d', '75b1579f-d142-4d03-8e5d-fb2d81369318', '5a44df53-98e4-4615-81e4-4e56d1a4d6e3', '8ebad646-47ba-428a-9d15-1cd36f881a6b'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc59439-b80a-43f5-a020-751216fef0fb]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_mj7ushsfdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:57 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:37:57 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:57 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_mj7ushsfdevstack@QuobyteHD Aug 05 10:37:57 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:58 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.275s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:37:58 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Deleted volume successfully. Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3ce66ec2-b9e1-49e7-84a4-fb9766133873 tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "cinder-6e35c2b3-5103-4d9c-9049-4791109fbb9b-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:37:58 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_mj7ushsfdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Temporary image 619f1530-41da-4b56-a554-65c809c7c1ea is fetched for user 3b8c54094ee24762809b2c26a7e475ad. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec786ee-30ac-4db1-b7cd-45b8e01f774b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_mj7ushsfdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:58 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_mj7ushsfdevstack@QuobyteHD Aug 05 10:37:58 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:58 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_mj7ushsfdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-124988330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0f141c-b526-44a0-8ff1-cdafdf60d534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e26d90b629840d98fc0cda821db4663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:37:57Z,use_quota=True,user_id='3b8c54094ee24762809b2c26a7e475ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Creating volume fd0f141c-b526-44a0-8ff1-cdafdf60d534 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:37:58 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:37:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:58 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534 1073741824 Aug 05 10:37:58 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:59 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534 1073741824" returned: 0 in 0.450s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:59 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534 Aug 05 10:37:59 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:59 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534" returned: 0 in 0.236s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:37:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:37:59 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Attempting download of 619f1530-41da-4b56-a554-65c809c7c1ea ((None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}])) to volume fd0f141c-b526-44a0-8ff1-cdafdf60d534. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:37:59 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08cd3ce-a4ce-4834-88ad-0e9892991b4e]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:37:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_djktyi0x {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:59 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_djktyi0x Aug 05 10:37:59 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:37:59 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Aug 05 10:37:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_djktyi0x" returned: 0 in 0.346s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:37:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_djktyi0x {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:37:59 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_djktyi0x Aug 05 10:37:59 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:00 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_djktyi0x" returned: 1 in 0.340s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_djktyi0x' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:38:00 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b3c75c-2f90-4211-a93f-d50961bf515f]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_mj7ushsfdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:00 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_mj7ushsfdevstack@QuobyteHD Aug 05 10:38:00 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:00 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_mj7ushsfdevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:00 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] 619f1530-41da-4b56-a554-65c809c7c1ea was qcow2, converting to qcow2 {{(pid=88736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:38:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_mj7ushsfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:00 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_mj7ushsfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534 Aug 05 10:38:00 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:00 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-dd80f133-b8db-4016-aa17-60fa6ef364f6 req-80da384e-9200-47df-b039-5fe2e25ebfcc tempest-TestInstancesWithCinderVolumes-756925004 None] Terminate volume connection completed successfully. Aug 05 10:38:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-dd80f133-b8db-4016-aa17-60fa6ef364f6 req-80da384e-9200-47df-b039-5fe2e25ebfcc tempest-TestInstancesWithCinderVolumes-756925004 None] Deleting attachment 3911953b-6066-4133-90c6-abb4a0477613. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:38:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "cinder-31345de8-bf52-4ff2-87b7-b8baafe468d5-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "cinder-31345de8-bf52-4ff2-87b7-b8baafe468d5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "cinder-quobyte-31345de8-bf52-4ff2-87b7-b8baafe468d5" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "cinder-quobyte-31345de8-bf52-4ff2-87b7-b8baafe468d5" acquired by "delete_volume" :: waited 0.034s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:01 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd500580-f1d2-4f09-92f2-d38a2483a609]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-31345de8-bf52-4ff2-87b7-b8baafe468d5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:01 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-31345de8-bf52-4ff2-87b7-b8baafe468d5 Aug 05 10:38:01 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:01 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-31345de8-bf52-4ff2-87b7-b8baafe468d5" returned: 0 in 0.457s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-31345de8-bf52-4ff2-87b7-b8baafe468d5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:01 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-31345de8-bf52-4ff2-87b7-b8baafe468d5 Aug 05 10:38:01 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:02 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-31345de8-bf52-4ff2-87b7-b8baafe468d5" returned: 0 in 0.291s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "cinder-quobyte-31345de8-bf52-4ff2-87b7-b8baafe468d5" released by "delete_volume" :: held 0.802s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:02 devstack cinder-volume[88736]: WARNING cinder.quota [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-887621426-2023187212 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-887621426-2023187212, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:38:02 devstack cinder-volume[88736]: WARNING cinder.quota [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-887621426-2023187212 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-887621426-2023187212, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Created reservations ['af06e876-9f18-46c1-ba7b-852234a9aedd', '58b6aa26-3096-4f84-8063-82414acf0e0a', 'f195c38e-d330-4d14-87b3-9da2451ab05c', 'aba8e827-e02c-4314-aa11-fbd2203b568c'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:02 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:38:02 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:02 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_mj7ushsfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534" returned: 0 in 1.881s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_mj7ushsfdevstack@QuobyteHD, size 112.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534 {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:38:02 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Converted 112.00 MB image at 59.51 MB/s Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:02 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534 1G Aug 05 10:38:02 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:02 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.291s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:38:02 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Deleted volume successfully. Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-98443c48-e087-4674-9c89-8ffa13d4fcc2 tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "cinder-31345de8-bf52-4ff2-87b7-b8baafe468d5-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:02 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534 1G" returned: 0 in 0.408s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Downloaded image 619f1530-41da-4b56-a554-65c809c7c1ea ((None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}])) to volume fd0f141c-b526-44a0-8ff1-cdafdf60d534 successfully. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Temporary image 619f1530-41da-4b56-a554-65c809c7c1ea for user 3b8c54094ee24762809b2c26a7e475ad is deleted. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Marking volume fd0f141c-b526-44a0-8ff1-cdafdf60d534 as bootable. {{(pid=88736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Copying metadata from image 619f1530-41da-4b56-a554-65c809c7c1ea to fd0f141c-b526-44a0-8ff1-cdafdf60d534. {{(pid=88736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Creating volume glance metadata for volume fd0f141c-b526-44a0-8ff1-cdafdf60d534 backed by image 619f1530-41da-4b56-a554-65c809c7c1ea with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a9dba9-3618-44be-bc23-a9765a4913db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534', 'volume_size': 1, 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73179855073b4e3ea3fba8cb6e296bd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/619f1530-41da-4b56-a554-65c809c7c1ea/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7163e83-f788-479a-a607-2693eba511e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:02 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Volume volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534 (fd0f141c-b526-44a0-8ff1-cdafdf60d534): created successfully Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7163e83-f788-479a-a607-2693eba511e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Flow 'volume_create_manager' (6930b720-8fa5-42d8-9598-f4a411a7e771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:38:02 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-df005168-a30f-4e9f-98dc-5d13af5a4d6d tempest-VolumesImageMetadata-91335629 None] Created volume successfully. Aug 05 10:38:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] Acquiring lock "cinder-fd0f141c-b526-44a0-8ff1-cdafdf60d534-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] Lock "cinder-fd0f141c-b526-44a0-8ff1-cdafdf60d534-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] Acquiring lock "cinder-quobyte-fd0f141c-b526-44a0-8ff1-cdafdf60d534" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] Lock "cinder-quobyte-fd0f141c-b526-44a0-8ff1-cdafdf60d534" acquired by "delete_volume" :: waited 0.028s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:04 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec2ed48-b138-41c9-bd7d-130df99e9794]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:04 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534 Aug 05 10:38:04 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:04 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534" returned: 0 in 0.372s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:04 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534 Aug 05 10:38:04 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:04 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fd0f141c-b526-44a0-8ff1-cdafdf60d534" returned: 0 in 0.369s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] Lock "cinder-quobyte-fd0f141c-b526-44a0-8ff1-cdafdf60d534" released by "delete_volume" :: held 0.797s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:04 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] Created reservations ['9eaae859-29d6-4f87-864c-997f65078dd3', '0d60854d-58d5-4259-a1ae-1935c3f10fa9', 'd7312b17-00e6-4812-b910-5a7736a26f4a', 'ee98f69e-a161-4ca4-bff2-5780b3e88a28'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:38:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:38:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:38:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:05 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:38:05 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:05 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.279s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:05 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:38:05 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] Deleted volume successfully. Aug 05 10:38:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bad67552-8ff4-4bdc-b9c6-1d5a202801c8 tempest-VolumesImageMetadata-91335629 None] Lock "cinder-fd0f141c-b526-44a0-8ff1-cdafdf60d534-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:05 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-3b1cb08c-0604-4a36-8b83-e6ca440d554f req-3ba18447-9be8-4737-92b4-ab2a7d791def tempest-TestInstancesWithCinderVolumes-756925004 None] Terminate volume connection completed successfully. Aug 05 10:38:05 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-3b1cb08c-0604-4a36-8b83-e6ca440d554f req-3ba18447-9be8-4737-92b4-ab2a7d791def tempest-TestInstancesWithCinderVolumes-756925004 None] Deleting attachment c547d580-81b4-428a-bc07-210b72c5f397. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:38:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "cinder-402c09ea-d64c-4b3b-ba3c-f93dc4496627-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "cinder-402c09ea-d64c-4b3b-ba3c-f93dc4496627-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "cinder-quobyte-402c09ea-d64c-4b3b-ba3c-f93dc4496627" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "cinder-quobyte-402c09ea-d64c-4b3b-ba3c-f93dc4496627" acquired by "delete_volume" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:06 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d557577a-e5b9-43b6-9b0c-8a06592f1ed0]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:06 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627 Aug 05 10:38:06 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:07 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627" returned: 0 in 0.387s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:07 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627 Aug 05 10:38:07 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:07 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-402c09ea-d64c-4b3b-ba3c-f93dc4496627" returned: 0 in 0.248s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "cinder-quobyte-402c09ea-d64c-4b3b-ba3c-f93dc4496627" released by "delete_volume" :: held 0.677s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:07 devstack cinder-volume[88736]: WARNING cinder.quota [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1216590083-76731322 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1216590083-76731322, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:38:07 devstack cinder-volume[88736]: WARNING cinder.quota [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1216590083-76731322 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1216590083-76731322, it is now deprecated. Please use the default quota class for default quota. Aug 05 10:38:07 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Created reservations ['b7378102-b7e7-4a67-8bb0-272d46d914f3', 'd9a411d5-d607-44d4-bd9f-7e74e8efa97d', '20244735-4143-4fe0-8e06-c9df47dc6265', '1d09c1db-2c15-4870-bb1c-aeeb416126ed'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:38:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:38:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:38:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:07 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:38:07 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:07 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.265s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:07 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:38:07 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Deleted volume successfully. Aug 05 10:38:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0520ed79-e7d7-45d2-8b06-b182a437890a tempest-TestInstancesWithCinderVolumes-756925004 None] Lock "cinder-402c09ea-d64c-4b3b-ba3c-f93dc4496627-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Flow 'volume_create_manager' (dddc0a91-bc45-470e-83eb-3117948387d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8938c2c4-008b-49a2-9353-5b703226a774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8938c2c4-008b-49a2-9353-5b703226a774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1060268659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d69b28-3a3f-498c-86ca-b3d6fa328de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34f55ec6720346308d295f7310eeff37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:38:09Z,use_quota=True,user_id='7e55ab4720354cb79aa2d13de09c7343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad97c066-3664-460c-b7f5-18bb64a18f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad97c066-3664-460c-b7f5-18bb64a18f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d0a637-b301-47f4-a1e1-88d95f02fcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d0a637-b301-47f4-a1e1-88d95f02fcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d69b28-3a3f-498c-86ca-b3d6fa328de6', 'volume_name': 'volume-e7d69b28-3a3f-498c-86ca-b3d6fa328de6', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4026b242-8e89-4a1a-8a1c-6768c357f6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4026b242-8e89-4a1a-8a1c-6768c357f6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f83568-5f59-408e-a9e6-0e1d42ad4dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:09 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Volume e7d69b28-3a3f-498c-86ca-b3d6fa328de6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d69b28-3a3f-498c-86ca-b3d6fa328de6', 'volume_size': 1} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1060268659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d69b28-3a3f-498c-86ca-b3d6fa328de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34f55ec6720346308d295f7310eeff37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:38:09Z,use_quota=True,user_id='7e55ab4720354cb79aa2d13de09c7343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Creating volume e7d69b28-3a3f-498c-86ca-b3d6fa328de6 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:38:09 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e7d69b28-3a3f-498c-86ca-b3d6fa328de6 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:09 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e7d69b28-3a3f-498c-86ca-b3d6fa328de6 1073741824 Aug 05 10:38:09 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:09 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e7d69b28-3a3f-498c-86ca-b3d6fa328de6 1073741824" returned: 0 in 0.425s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e7d69b28-3a3f-498c-86ca-b3d6fa328de6 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:09 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e7d69b28-3a3f-498c-86ca-b3d6fa328de6 Aug 05 10:38:09 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:09 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e7d69b28-3a3f-498c-86ca-b3d6fa328de6" returned: 0 in 0.297s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f83568-5f59-408e-a9e6-0e1d42ad4dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d69b28-3a3f-498c-86ca-b3d6fa328de6', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3264c0d-5643-4865-b7f4-0e5b41d9f385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:09 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Volume volume-e7d69b28-3a3f-498c-86ca-b3d6fa328de6 (e7d69b28-3a3f-498c-86ca-b3d6fa328de6): created successfully Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3264c0d-5643-4865-b7f4-0e5b41d9f385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Flow 'volume_create_manager' (dddc0a91-bc45-470e-83eb-3117948387d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:38:09 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e4aa3144-caa1-4cc6-a8d7-19b00a88a549 tempest-AbsoluteLimitsTests-1681054389 None] Created volume successfully. Aug 05 10:38:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] Acquiring lock "cinder-e7d69b28-3a3f-498c-86ca-b3d6fa328de6-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] Lock "cinder-e7d69b28-3a3f-498c-86ca-b3d6fa328de6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] Acquiring lock "cinder-quobyte-e7d69b28-3a3f-498c-86ca-b3d6fa328de6" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] Lock "cinder-quobyte-e7d69b28-3a3f-498c-86ca-b3d6fa328de6" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:10 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[440a9dfc-253b-41f2-b2d7-5a7c41068e20]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e7d69b28-3a3f-498c-86ca-b3d6fa328de6 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:10 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e7d69b28-3a3f-498c-86ca-b3d6fa328de6 Aug 05 10:38:10 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:10 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e7d69b28-3a3f-498c-86ca-b3d6fa328de6" returned: 0 in 0.387s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e7d69b28-3a3f-498c-86ca-b3d6fa328de6 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:10 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e7d69b28-3a3f-498c-86ca-b3d6fa328de6 Aug 05 10:38:10 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:10 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e7d69b28-3a3f-498c-86ca-b3d6fa328de6" returned: 0 in 0.252s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] Lock "cinder-quobyte-e7d69b28-3a3f-498c-86ca-b3d6fa328de6" released by "delete_volume" :: held 0.680s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:11 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] Created reservations ['96ef7db5-df5c-442c-bba2-f659730ccd42', 'b97b17df-c2a4-4f96-86a0-0a716ab28196', '2ccf5fe9-af8c-4a74-8116-a6f233ea8042', '52ff751e-4e0f-4a8d-9a92-c9d0f9ec2f06'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:38:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:38:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:38:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:11 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:38:11 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:11 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.255s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:11 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:38:11 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] Deleted volume successfully. Aug 05 10:38:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-242e5fb0-3ef5-4f9c-866b-c6bdbd81701c tempest-AbsoluteLimitsTests-1681054389 None] Lock "cinder-e7d69b28-3a3f-498c-86ca-b3d6fa328de6-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:38:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:38:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:38:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:13 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:38:13 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:14 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.270s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:38:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:38:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:38:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Flow 'volume_create_manager' (44540c21-be52-4d63-a292-29614c5091c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de82887-09fe-4bed-9bdc-253df4ea631a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de82887-09fe-4bed-9bdc-253df4ea631a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1114502087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629efc09-78ef-4d35-a42e-60def6d625bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be90efb17a0a4d59a373fc8b4cfe7738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:38:16Z,use_quota=True,user_id='be2b08a69593447ba174d9cc01e34dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba16547-80ee-4430-abee-efbc3a2fd6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba16547-80ee-4430-abee-efbc3a2fd6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1045bb87-7044-4b06-96dc-2194eccb7561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1045bb87-7044-4b06-96dc-2194eccb7561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '629efc09-78ef-4d35-a42e-60def6d625bc', 'volume_name': 'volume-629efc09-78ef-4d35-a42e-60def6d625bc', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139db921-6bae-4993-acbd-30b4337046b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139db921-6bae-4993-acbd-30b4337046b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5b03e7-a02b-4b66-824e-23bd020eb3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:15 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Volume 629efc09-78ef-4d35-a42e-60def6d625bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-629efc09-78ef-4d35-a42e-60def6d625bc', 'volume_size': 1} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1114502087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629efc09-78ef-4d35-a42e-60def6d625bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be90efb17a0a4d59a373fc8b4cfe7738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:38:16Z,use_quota=True,user_id='be2b08a69593447ba174d9cc01e34dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Creating volume 629efc09-78ef-4d35-a42e-60def6d625bc {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:38:15 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:38:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:15 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc 1073741824 Aug 05 10:38:15 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:16 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc 1073741824" returned: 0 in 0.438s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:16 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc Aug 05 10:38:16 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:16 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc" returned: 0 in 0.246s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:16 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:38:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:16 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5b03e7-a02b-4b66-824e-23bd020eb3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-629efc09-78ef-4d35-a42e-60def6d625bc', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:16 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9c37e6-95d6-4956-b613-a1e07d1bbdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:16 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Volume volume-629efc09-78ef-4d35-a42e-60def6d625bc (629efc09-78ef-4d35-a42e-60def6d625bc): created successfully Aug 05 10:38:16 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9c37e6-95d6-4956-b613-a1e07d1bbdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:16 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Flow 'volume_create_manager' (44540c21-be52-4d63-a292-29614c5091c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:38:16 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d276669f-6561-4eaa-88f1-a07201647018 tempest-VolumesCloneTest-161842218 None] Created volume successfully. Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Flow 'volume_create_manager' (803d6e49-2b48-4642-b2c5-557394fed0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f990d97d-822e-4a00-ac0b-7e4e6674cbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f990d97d-822e-4a00-ac0b-7e4e6674cbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-954225620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de884932-8098-4846-98e1-e4e634c79a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be90efb17a0a4d59a373fc8b4cfe7738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:38:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=629efc09-78ef-4d35-a42e-60def6d625bc,status='creating',terminated_at=None,updated_at=2026-08-05T08:38:17Z,use_quota=True,user_id='be2b08a69593447ba174d9cc01e34dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4e2a98-a488-4b24-b927-6c63bf33c449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4e2a98-a488-4b24-b927-6c63bf33c449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea823f88-b2ce-4e2e-8c07-434827d0cc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea823f88-b2ce-4e2e-8c07-434827d0cc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'de884932-8098-4846-98e1-e4e634c79a7a', 'volume_name': 'volume-de884932-8098-4846-98e1-e4e634c79a7a', 'volume_size': 2, 'source_volid': '629efc09-78ef-4d35-a42e-60def6d625bc', 'source_volstatus': 'available'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfaca5b7-ca11-447b-bcbe-34564120852e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfaca5b7-ca11-447b-bcbe-34564120852e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931131fd-cdb2-4a50-a630-280dbd20c168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:17 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Volume de884932-8098-4846-98e1-e4e634c79a7a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-de884932-8098-4846-98e1-e4e634c79a7a', 'volume_size': 2, 'source_volid': '629efc09-78ef-4d35-a42e-60def6d625bc', 'source_volstatus': 'available'} Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:17 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Cloning volume 629efc09-78ef-4d35-a42e-60def6d625bc to volume de884932-8098-4846-98e1-e4e634c79a7a Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Creating offline snapshot 1db5faba-3f41-4213-8f82-5b14d6e81896 of volume 629efc09-78ef-4d35-a42e-60def6d625bc {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[767cd1d8-de7f-4e41-89ee-d5da6845a000]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:17 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc Aug 05 10:38:17 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:17 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc" returned: 0 in 0.369s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:17 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896 1G Aug 05 10:38:17 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:18 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896 1G" returned: 0 in 0.415s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-629efc09-78ef-4d35-a42e-60def6d625bc -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:18 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-629efc09-78ef-4d35-a42e-60def6d625bc -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896 Aug 05 10:38:18 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:18 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-629efc09-78ef-4d35-a42e-60def6d625bc -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896" returned: 0 in 0.303s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:18 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896 is being set with open permissions: ugo+rw Aug 05 10:38:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:18 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896 Aug 05 10:38:18 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:18 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896" returned: 0 in 0.273s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:18 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.info Aug 05 10:38:18 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:19 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.info" returned: 0 in 0.270s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:19 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.info is being set with open permissions: ugo+rw Aug 05 10:38:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:19 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.info Aug 05 10:38:19 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:19 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.info" returned: 0 in 0.270s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Acquiring lock "cinder-quobyte-de884932-8098-4846-98e1-e4e634c79a7a" by "_copy_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Lock "cinder-quobyte-de884932-8098-4846-98e1-e4e634c79a7a" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] snapshot: 1db5faba-3f41-4213-8f82-5b14d6e81896, volume: de884932-8098-4846-98e1-e4e634c79a7a, {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:38:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:38:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:38:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:19 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cc5d7a-02c7-4c9f-9d6f-a4659e42e392]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:19 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896 Aug 05 10:38:19 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:19 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896" returned: 0 in 0.401s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-629efc09-78ef-4d35-a42e-60def6d625bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:38:19 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf15645b-6456-429d-8e50-ab03e16f5af4]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:19 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc Aug 05 10:38:19 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:20 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc" returned: 0 in 0.359s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:20 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] will copy from snapshot at /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:38:20 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Creating direct copy from snapshot {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:38:20 devstack cinder-volume[88736]: DEBUG cinder.utils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Path /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de884932-8098-4846-98e1-e4e634c79a7a not found in is_blk_device check {{(pid=88736) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:38:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de884932-8098-4846-98e1-e4e634c79a7a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:20 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de884932-8098-4846-98e1-e4e634c79a7a Aug 05 10:38:20 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:25 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de884932-8098-4846-98e1-e4e634c79a7a" returned: 0 in 5.022s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:25 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Image conversion details: src /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc, size 1024.00 MB, duration 5.02 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de884932-8098-4846-98e1-e4e634c79a7a {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:38:25 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Converted 1024.00 MB image at 203.82 MB/s Aug 05 10:38:25 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de884932-8098-4846-98e1-e4e634c79a7a is being set with open permissions: ugo+rw Aug 05 10:38:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de884932-8098-4846-98e1-e4e634c79a7a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:25 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de884932-8098-4846-98e1-e4e634c79a7a Aug 05 10:38:25 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:25 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de884932-8098-4846-98e1-e4e634c79a7a" returned: 0 in 0.270s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Lock "cinder-quobyte-de884932-8098-4846-98e1-e4e634c79a7a" released by "_copy_volume_from_snapshot" :: held 6.137s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Acquiring lock "cinder-quobyte-1db5faba-3f41-4213-8f82-5b14d6e81896" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Lock "cinder-quobyte-1db5faba-3f41-4213-8f82-5b14d6e81896" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Deleting offline snapshot 1db5faba-3f41-4213-8f82-5b14d6e81896 of volume 629efc09-78ef-4d35-a42e-60def6d625bc {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:38:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] snapshot_file for this snap is: volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:38:25 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a319e2b4-8421-486e-b4ed-b20b87c7ff96]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:25 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896 Aug 05 10:38:25 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:25 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896" returned: 0 in 0.415s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-629efc09-78ef-4d35-a42e-60def6d625bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:38:26 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[876df23a-8876-45d4-8230-0e055717f03e]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:26 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc Aug 05 10:38:26 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:26 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc" returned: 0 in 0.587s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:26 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896 Aug 05 10:38:26 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:26 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896" returned: 0 in 0.345s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:26 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896 Aug 05 10:38:26 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:27 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc.1db5faba-3f41-4213-8f82-5b14d6e81896" returned: 0 in 0.260s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Lock "cinder-quobyte-1db5faba-3f41-4213-8f82-5b14d6e81896" released by "_delete_snapshot" :: held 1.719s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.963s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931131fd-cdb2-4a50-a630-280dbd20c168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de884932-8098-4846-98e1-e4e634c79a7a', 'volume_size': 2, 'source_volid': '629efc09-78ef-4d35-a42e-60def6d625bc', 'source_volstatus': 'available'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd301c45-3df6-4374-b802-18b4c5a5b057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:27 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Volume volume-de884932-8098-4846-98e1-e4e634c79a7a (de884932-8098-4846-98e1-e4e634c79a7a): created successfully Aug 05 10:38:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd301c45-3df6-4374-b802-18b4c5a5b057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Flow 'volume_create_manager' (803d6e49-2b48-4642-b2c5-557394fed0a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:38:27 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-bda711e7-357e-44ad-841e-c7e8a6b79fe8 tempest-VolumesCloneTest-161842218 None] Created volume successfully. Aug 05 10:38:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] Acquiring lock "cinder-de884932-8098-4846-98e1-e4e634c79a7a-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] Lock "cinder-de884932-8098-4846-98e1-e4e634c79a7a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] Acquiring lock "cinder-quobyte-de884932-8098-4846-98e1-e4e634c79a7a" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] Lock "cinder-quobyte-de884932-8098-4846-98e1-e4e634c79a7a" acquired by "delete_volume" :: waited 0.013s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:28 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cc034f-29cf-4b5e-ab13-6bc89f2f83b1]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de884932-8098-4846-98e1-e4e634c79a7a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:28 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de884932-8098-4846-98e1-e4e634c79a7a Aug 05 10:38:28 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:28 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de884932-8098-4846-98e1-e4e634c79a7a" returned: 0 in 0.368s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de884932-8098-4846-98e1-e4e634c79a7a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:28 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de884932-8098-4846-98e1-e4e634c79a7a Aug 05 10:38:28 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:28 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de884932-8098-4846-98e1-e4e634c79a7a" returned: 0 in 0.250s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] Lock "cinder-quobyte-de884932-8098-4846-98e1-e4e634c79a7a" released by "delete_volume" :: held 0.661s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:28 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] Created reservations ['94184309-1603-4446-8da4-5b099d7be6bb', '02c80131-7289-4efd-8de4-8205887b7e89', 'ad921b67-11ff-4add-b0c9-762213204c6f', '66a5a4c0-8ae2-49a2-a5e0-24b620db5043'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:38:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:38:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:38:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:29 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:38:29 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:29 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.248s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:29 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:38:29 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] Deleted volume successfully. Aug 05 10:38:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-66e7e253-63fb-4be3-89d4-af8e61480b0d tempest-VolumesCloneTest-161842218 None] Lock "cinder-de884932-8098-4846-98e1-e4e634c79a7a-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] Acquiring lock "cinder-629efc09-78ef-4d35-a42e-60def6d625bc-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] Lock "cinder-629efc09-78ef-4d35-a42e-60def6d625bc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] Acquiring lock "cinder-quobyte-629efc09-78ef-4d35-a42e-60def6d625bc" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] Lock "cinder-quobyte-629efc09-78ef-4d35-a42e-60def6d625bc" acquired by "delete_volume" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:29 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeeecfd4-abde-4afe-bd0a-adae012f2ced]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:29 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc Aug 05 10:38:29 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:29 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc" returned: 0 in 0.378s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:30 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc Aug 05 10:38:30 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:30 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-629efc09-78ef-4d35-a42e-60def6d625bc" returned: 0 in 0.266s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] Lock "cinder-quobyte-629efc09-78ef-4d35-a42e-60def6d625bc" released by "delete_volume" :: held 0.705s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:30 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] Created reservations ['d1a50a57-8dfb-42cb-b957-dc73d29370cf', 'ddc63de7-9bbf-48cb-8171-5799fcecabfb', '69f73db9-2cec-41ce-b392-9dc54c663c33', '153fcf22-e107-45d2-8cf0-a9af8d176e58'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:38:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:38:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:38:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:30 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:38:30 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:30 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.267s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:30 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:38:30 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] Deleted volume successfully. Aug 05 10:38:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b3c301df-a387-4583-b8c6-d7201160a86b tempest-VolumesCloneTest-161842218 None] Lock "cinder-629efc09-78ef-4d35-a42e-60def6d625bc-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:33 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:38:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Flow 'volume_create_manager' (5057844f-3fed-4373-ac14-1afd83f2ffd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:38:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8e06f8-ed0d-4b6c-b13d-3657d46a46c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8e06f8-ed0d-4b6c-b13d-3657d46a46c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1583035635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa146304b9a44a85a5cf9fbc02bb8769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:38:34Z,use_quota=True,user_id='fa19d0997b124af482b06d6cf6b1d030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6e0412-2643-44ee-888a-64aa4d38e840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6e0412-2643-44ee-888a-64aa4d38e840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea81474-a16a-41f7-8493-97a67e613e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:33 devstack cinder-volume[88736]: DEBUG cinder.image.glance [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Creating Keystone auth plugin from conf {{(pid=88736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:38:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea81474-a16a-41f7-8493-97a67e613e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295', 'volume_name': 'volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295', 'volume_size': 1, 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73179855073b4e3ea3fba8cb6e296bd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/619f1530-41da-4b56-a554-65c809c7c1ea/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8820e0-896f-4214-802a-81b85d91105d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8820e0-896f-4214-802a-81b85d91105d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1688785c-3920-4a6f-94c3-f4dc1c8bb7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:34 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Volume d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295', 'volume_size': 1, 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73179855073b4e3ea3fba8cb6e296bd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/619f1530-41da-4b56-a554-65c809c7c1ea/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 10:38:34 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Trying to clone d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 from image 619f1530-41da-4b56-a554-65c809c7c1ea at location (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]). {{(pid=88736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:38:34 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_6yz5bd7vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:38:34 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Image download 20.69 MB at 20.69 MB/s Aug 05 10:38:34 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9cdeaa-7426-4fb9-b222-efbeddbbf309]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_6yz5bd7vdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:34 devstack sudo[103719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_6yz5bd7vdevstack@QuobyteHD Aug 05 10:38:34 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:35 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_6yz5bd7vdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:35 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Temporary image 619f1530-41da-4b56-a554-65c809c7c1ea is fetched for user fa19d0997b124af482b06d6cf6b1d030. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:38:35 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[20be57da-71c7-4c22-b03e-4325ef9de580]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_6yz5bd7vdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:35 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_6yz5bd7vdevstack@QuobyteHD Aug 05 10:38:35 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:35 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_6yz5bd7vdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1583035635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa146304b9a44a85a5cf9fbc02bb8769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:38:34Z,use_quota=True,user_id='fa19d0997b124af482b06d6cf6b1d030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:38:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Creating volume d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:38:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:38:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:38:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:38:35 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:38:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:35 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 1073741824 Aug 05 10:38:35 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:36 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 1073741824" returned: 0 in 0.564s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:36 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 Aug 05 10:38:36 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:36 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295" returned: 0 in 0.271s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:38:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:36 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Attempting download of 619f1530-41da-4b56-a554-65c809c7c1ea ((None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}])) to volume d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:38:36 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab6a7cf-f2a3-4c2f-8a39-0dc7dd06e788]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_7mumopok {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:36 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_7mumopok Aug 05 10:38:36 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:36 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_7mumopok" returned: 0 in 0.360s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_7mumopok {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:36 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_7mumopok Aug 05 10:38:36 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:37 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_7mumopok" returned: 1 in 0.371s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_7mumopok' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:38:37 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5786ef-03fa-44b4-974f-171cef64051b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_6yz5bd7vdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:37 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_6yz5bd7vdevstack@QuobyteHD Aug 05 10:38:37 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:37 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_6yz5bd7vdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:37 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] 619f1530-41da-4b56-a554-65c809c7c1ea was qcow2, converting to qcow2 {{(pid=88736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:38:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_6yz5bd7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:37 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_6yz5bd7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 Aug 05 10:38:37 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:39 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_6yz5bd7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295" returned: 0 in 1.802s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:39 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_6yz5bd7vdevstack@QuobyteHD, size 112.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:38:39 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Converted 112.00 MB image at 62.11 MB/s Aug 05 10:38:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:39 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 1G Aug 05 10:38:39 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:39 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 1G" returned: 0 in 0.315s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:39 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Downloaded image 619f1530-41da-4b56-a554-65c809c7c1ea ((None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}])) to volume d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 successfully. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:38:39 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Temporary image 619f1530-41da-4b56-a554-65c809c7c1ea for user fa19d0997b124af482b06d6cf6b1d030 is deleted. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:38:39 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Marking volume d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 as bootable. {{(pid=88736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:38:39 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=90,cinder:UPDATE=90,cinder:DELETE=9,cinder:INSERT=28 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:38:39 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Copying metadata from image 619f1530-41da-4b56-a554-65c809c7c1ea to d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295. {{(pid=88736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:38:39 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Creating volume glance metadata for volume d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 backed by image 619f1530-41da-4b56-a554-65c809c7c1ea with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:38:39 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=85,cinder:UPDATE=96,cinder:INSERT=26,cinder:DELETE=4 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:38:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1688785c-3920-4a6f-94c3-f4dc1c8bb7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295', 'volume_size': 1, 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73179855073b4e3ea3fba8cb6e296bd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/619f1530-41da-4b56-a554-65c809c7c1ea/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c0b713-2cfd-46b8-b785-dc465b7e2529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:39 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Volume volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 (d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295): created successfully Aug 05 10:38:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c0b713-2cfd-46b8-b785-dc465b7e2529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Flow 'volume_create_manager' (5057844f-3fed-4373-ac14-1afd83f2ffd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:38:39 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-f43a37f0-2435-49b5-8295-ade33558da26 tempest-VolumesExtendTest-135956924 None] Created volume successfully. Aug 05 10:38:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bee730f4-e4ad-4782-ba59-03b1b939fff1 tempest-VolumesExtendTest-135956924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bee730f4-e4ad-4782-ba59-03b1b939fff1 tempest-VolumesExtendTest-135956924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:40 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1c384f-e628-4b55-98f7-5c7b8e030f0d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bee730f4-e4ad-4782-ba59-03b1b939fff1 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:40 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 Aug 05 10:38:40 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:40 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bee730f4-e4ad-4782-ba59-03b1b939fff1 tempest-VolumesExtendTest-135956924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295" returned: 0 in 0.407s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bee730f4-e4ad-4782-ba59-03b1b939fff1 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 2G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bee730f4-e4ad-4782-ba59-03b1b939fff1 tempest-VolumesExtendTest-135956924 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 2G" returned: 0 in 0.101s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bee730f4-e4ad-4782-ba59-03b1b939fff1 tempest-VolumesExtendTest-135956924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.543s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:40 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-bee730f4-e4ad-4782-ba59-03b1b939fff1 tempest-VolumesExtendTest-135956924 None] Extend volume completed successfully. Aug 05 10:38:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] Acquiring lock "cinder-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] Lock "cinder-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] Acquiring lock "cinder-quobyte-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] Lock "cinder-quobyte-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295" acquired by "delete_volume" :: waited 0.024s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:41 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9936cdb8-906c-447c-af0d-fd584dc647d7]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:42 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 Aug 05 10:38:42 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:42 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295" returned: 0 in 0.394s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:42 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295 Aug 05 10:38:42 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:42 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295" returned: 0 in 0.272s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] Lock "cinder-quobyte-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295" released by "delete_volume" :: held 0.733s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:42 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] Created reservations ['a2e1db5a-5cc2-4798-9bbb-6133737844bb', 'b486b76b-7bd8-471a-aac1-409fa62c7fdd', '2719a0bb-b675-43f4-ad85-89a85282a5c0', '0f5120a9-f966-47be-b426-6816bc251654'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:38:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:38:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:38:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:42 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:38:42 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:43 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.320s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:38:43 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] Deleted volume successfully. Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-680f7858-5912-4c27-b98d-a9443f13a498 tempest-VolumesExtendTest-135956924 None] Lock "cinder-d9baf8f1-3bf7-4e5c-8fe1-91b46e3ae295-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Flow 'volume_create_manager' (d24be056-352f-490d-b71a-ec7f2a25cb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c3072f-d74c-4066-9234-613ab4363e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c3072f-d74c-4066-9234-613ab4363e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1884678629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525c7790-48b2-4c8f-806e-820a70ff273c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa146304b9a44a85a5cf9fbc02bb8769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:38:43Z,use_quota=True,user_id='fa19d0997b124af482b06d6cf6b1d030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de761008-0ce8-4826-95e5-a4f64967b9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de761008-0ce8-4826-95e5-a4f64967b9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df413883-4ae1-4041-a501-aeb4b34513d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df413883-4ae1-4041-a501-aeb4b34513d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '525c7790-48b2-4c8f-806e-820a70ff273c', 'volume_name': 'volume-525c7790-48b2-4c8f-806e-820a70ff273c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208f1bcc-729d-4595-845e-702cc7eb4540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208f1bcc-729d-4595-845e-702cc7eb4540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b714b4-276e-4403-a11f-8485781610f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:43 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Volume 525c7790-48b2-4c8f-806e-820a70ff273c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-525c7790-48b2-4c8f-806e-820a70ff273c', 'volume_size': 1} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1884678629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525c7790-48b2-4c8f-806e-820a70ff273c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa146304b9a44a85a5cf9fbc02bb8769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:38:43Z,use_quota=True,user_id='fa19d0997b124af482b06d6cf6b1d030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Creating volume 525c7790-48b2-4c8f-806e-820a70ff273c {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:38:43 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:43 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c 1073741824 Aug 05 10:38:43 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:43 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c 1073741824" returned: 0 in 0.506s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:44 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c Aug 05 10:38:44 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:44 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c" returned: 0 in 0.246s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:38:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b714b4-276e-4403-a11f-8485781610f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-525c7790-48b2-4c8f-806e-820a70ff273c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b532f234-f4dd-4ad2-87d1-d499da2f1177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:44 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Volume volume-525c7790-48b2-4c8f-806e-820a70ff273c (525c7790-48b2-4c8f-806e-820a70ff273c): created successfully Aug 05 10:38:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b532f234-f4dd-4ad2-87d1-d499da2f1177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Flow 'volume_create_manager' (d24be056-352f-490d-b71a-ec7f2a25cb78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:38:44 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-fc97875c-9560-47e6-b6a6-1a9430fd535d tempest-VolumesExtendTest-135956924 None] Created volume successfully. Aug 05 10:38:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] Creating offline snapshot 80fc4972-069c-4dbc-8462-decc73a00395 of volume 525c7790-48b2-4c8f-806e-820a70ff273c {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:38:45 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[647a6f5f-499d-4147-868b-66d73b671fa2]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:45 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c Aug 05 10:38:45 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:46 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c" returned: 0 in 0.387s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:46 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395 1G Aug 05 10:38:46 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:46 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395 1G" returned: 0 in 0.412s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-525c7790-48b2-4c8f-806e-820a70ff273c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:46 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-525c7790-48b2-4c8f-806e-820a70ff273c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395 Aug 05 10:38:46 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:46 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-525c7790-48b2-4c8f-806e-820a70ff273c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395" returned: 0 in 0.378s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:46 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395 is being set with open permissions: ugo+rw Aug 05 10:38:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:46 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395 Aug 05 10:38:46 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:47 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395" returned: 0 in 0.301s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:47 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.info Aug 05 10:38:47 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:47 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.info" returned: 0 in 0.270s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:47 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.info is being set with open permissions: ugo+rw Aug 05 10:38:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:47 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.info Aug 05 10:38:47 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:47 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.info" returned: 0 in 0.266s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:47 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d32e0c69-e463-4823-b222-c0f72270ad2c tempest-VolumesExtendTest-135956924 None] Create snapshot completed successfully Aug 05 10:38:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5b3490e8-fb0b-457a-80bd-767f0621c579 tempest-VolumesExtendTest-135956924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5b3490e8-fb0b-457a-80bd-767f0621c579 tempest-VolumesExtendTest-135956924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:49 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[643fb8c6-1af2-48d8-804f-a345765990bb]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5b3490e8-fb0b-457a-80bd-767f0621c579 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:49 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c Aug 05 10:38:49 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:49 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5b3490e8-fb0b-457a-80bd-767f0621c579 tempest-VolumesExtendTest-135956924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c" returned: 0 in 0.467s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5b3490e8-fb0b-457a-80bd-767f0621c579 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395 2G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5b3490e8-fb0b-457a-80bd-767f0621c579 tempest-VolumesExtendTest-135956924 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395 2G" returned: 0 in 0.141s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5b3490e8-fb0b-457a-80bd-767f0621c579 tempest-VolumesExtendTest-135956924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.656s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:49 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-5b3490e8-fb0b-457a-80bd-767f0621c579 tempest-VolumesExtendTest-135956924 None] Extend volume completed successfully. Aug 05 10:38:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] Acquiring lock "cinder-80fc4972-069c-4dbc-8462-decc73a00395-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] Lock "cinder-80fc4972-069c-4dbc-8462-decc73a00395-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] Acquiring lock "cinder-quobyte-525c7790-48b2-4c8f-806e-820a70ff273c" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] Lock "cinder-quobyte-525c7790-48b2-4c8f-806e-820a70ff273c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] Acquiring lock "cinder-quobyte-80fc4972-069c-4dbc-8462-decc73a00395" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] Lock "cinder-quobyte-80fc4972-069c-4dbc-8462-decc73a00395" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] Deleting offline snapshot 80fc4972-069c-4dbc-8462-decc73a00395 of volume 525c7790-48b2-4c8f-806e-820a70ff273c {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:38:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] snapshot_file for this snap is: volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:38:50 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0900b41d-a7b8-455f-8227-6adc0e3d6876]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:50 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395 Aug 05 10:38:50 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:50 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395" returned: 0 in 0.360s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-525c7790-48b2-4c8f-806e-820a70ff273c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:38:50 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07593d3-990d-4c74-a463-b9d1deee4f8a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:50 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c Aug 05 10:38:50 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:51 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c" returned: 0 in 0.373s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:51 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395 Aug 05 10:38:51 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:51 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395" returned: 0 in 0.401s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:51 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395 Aug 05 10:38:51 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:51 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c.80fc4972-069c-4dbc-8462-decc73a00395" returned: 0 in 0.268s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] Lock "cinder-quobyte-80fc4972-069c-4dbc-8462-decc73a00395" released by "_delete_snapshot" :: held 1.509s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] Lock "cinder-quobyte-525c7790-48b2-4c8f-806e-820a70ff273c" released by "delete_snapshot" :: held 1.534s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:51 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] Created reservations ['14ebe1b5-123d-4b3f-b8fb-1de2d3916f6c', '64a4332f-374e-4229-a3d4-e0b647084080', '30e08414-8153-4932-a730-54704ec58902', 'c984bf4e-a947-4ef3-a322-9f163fa76bce'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:38:51 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] Delete snapshot completed successfully. Aug 05 10:38:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-dad6c09d-2248-4b08-8b49-d40068d37f67 tempest-VolumesExtendTest-135956924 None] Lock "cinder-80fc4972-069c-4dbc-8462-decc73a00395-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] Acquiring lock "cinder-525c7790-48b2-4c8f-806e-820a70ff273c-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] Lock "cinder-525c7790-48b2-4c8f-806e-820a70ff273c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] Acquiring lock "cinder-quobyte-525c7790-48b2-4c8f-806e-820a70ff273c" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:38:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] Lock "cinder-quobyte-525c7790-48b2-4c8f-806e-820a70ff273c" acquired by "delete_volume" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:38:52 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ca4d39-dd4e-4705-8ddf-2defa9b9f2f8]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:38:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:52 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c Aug 05 10:38:52 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:53 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c" returned: 0 in 0.380s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:53 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c Aug 05 10:38:53 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:53 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-525c7790-48b2-4c8f-806e-820a70ff273c" returned: 0 in 0.255s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] Lock "cinder-quobyte-525c7790-48b2-4c8f-806e-820a70ff273c" released by "delete_volume" :: held 0.702s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:53 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] Created reservations ['d6740dca-25e4-46a1-aca7-92a402c7a19a', 'd71291ee-30c0-482f-ac02-0faac987ee93', 'e8b7f8ab-5f8a-479e-9ece-b5c13eae5f28', '3261726b-23ee-44e3-a684-841686044c3f'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:38:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:38:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:38:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:53 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:38:53 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:53 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.283s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:53 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:38:53 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] Deleted volume successfully. Aug 05 10:38:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cffbadfe-530e-448b-be9e-55cb7bb747a7 tempest-VolumesExtendTest-135956924 None] Lock "cinder-525c7790-48b2-4c8f-806e-820a70ff273c-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Flow 'volume_create_manager' (c58c6540-4461-40c0-83ae-9752341044c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89216e4-ce38-4627-be4e-d0674fa7ed79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89216e4-ce38-4627-be4e-d0674fa7ed79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-322214714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28934a19-94a6-4fb4-bbd8-fe855ff881c3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61aac5dd4ef542f686de9ecaa6c0d37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:38:57Z,use_quota=True,user_id='71db3438cdc44647bb0fdad13c952db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e087ce-f1e1-4f7e-913d-dfbd4f2f88d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e087ce-f1e1-4f7e-913d-dfbd4f2f88d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2968658-21ce-4be5-963e-4808c0087954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2968658-21ce-4be5-963e-4808c0087954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28934a19-94a6-4fb4-bbd8-fe855ff881c3', 'volume_name': 'volume-28934a19-94a6-4fb4-bbd8-fe855ff881c3', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9540e2be-ffef-4a75-972f-e7506095dfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9540e2be-ffef-4a75-972f-e7506095dfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9d30db-1314-4ff5-9264-fb4bd8426210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:56 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Volume 28934a19-94a6-4fb4-bbd8-fe855ff881c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28934a19-94a6-4fb4-bbd8-fe855ff881c3', 'volume_size': 1} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-322214714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28934a19-94a6-4fb4-bbd8-fe855ff881c3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61aac5dd4ef542f686de9ecaa6c0d37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:38:57Z,use_quota=True,user_id='71db3438cdc44647bb0fdad13c952db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Creating volume 28934a19-94a6-4fb4-bbd8-fe855ff881c3 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:38:56 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:38:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28934a19-94a6-4fb4-bbd8-fe855ff881c3 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:56 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28934a19-94a6-4fb4-bbd8-fe855ff881c3 1073741824 Aug 05 10:38:56 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:57 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28934a19-94a6-4fb4-bbd8-fe855ff881c3 1073741824" returned: 0 in 0.415s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28934a19-94a6-4fb4-bbd8-fe855ff881c3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:57 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28934a19-94a6-4fb4-bbd8-fe855ff881c3 Aug 05 10:38:57 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:57 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28934a19-94a6-4fb4-bbd8-fe855ff881c3" returned: 0 in 0.255s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:38:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9d30db-1314-4ff5-9264-fb4bd8426210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28934a19-94a6-4fb4-bbd8-fe855ff881c3', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8635c45c-44df-4fb4-babe-bc6002aca00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:57 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Volume volume-28934a19-94a6-4fb4-bbd8-fe855ff881c3 (28934a19-94a6-4fb4-bbd8-fe855ff881c3): created successfully Aug 05 10:38:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8635c45c-44df-4fb4-babe-bc6002aca00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Flow 'volume_create_manager' (c58c6540-4461-40c0-83ae-9752341044c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:38:57 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-f6e33197-d89f-4a27-85fe-56f874d78513 tempest-VolumesGetTest-1120561712 None] Created volume successfully. Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Flow 'volume_create_manager' (cea03a01-7b5d-41fe-a98f-a3fd3c8d658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea470f1-23cf-4afb-a147-35ac763d1299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea470f1-23cf-4afb-a147-35ac763d1299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:38:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-892936094',display_name='tempest-VolumesGetTest-Volume-542158458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016c2fd2-0328-4a12-aa22-83350aafe83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61aac5dd4ef542f686de9ecaa6c0d37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:38:58Z,use_quota=True,user_id='71db3438cdc44647bb0fdad13c952db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e44a1d-ed76-4271-a55d-598c302e3ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e44a1d-ed76-4271-a55d-598c302e3ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e1f744b-d4d4-42ef-ab6c-305d9d48ec36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e1f744b-d4d4-42ef-ab6c-305d9d48ec36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '016c2fd2-0328-4a12-aa22-83350aafe83c', 'volume_name': 'volume-016c2fd2-0328-4a12-aa22-83350aafe83c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551856b4-af0c-4876-a165-e878b92ff951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551856b4-af0c-4876-a165-e878b92ff951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caded2f4-8359-4688-a0dd-e4e3197e303b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:58 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Volume 016c2fd2-0328-4a12-aa22-83350aafe83c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-016c2fd2-0328-4a12-aa22-83350aafe83c', 'volume_size': 1} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:38:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-892936094',display_name='tempest-VolumesGetTest-Volume-542158458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016c2fd2-0328-4a12-aa22-83350aafe83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61aac5dd4ef542f686de9ecaa6c0d37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:38:58Z,use_quota=True,user_id='71db3438cdc44647bb0fdad13c952db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Creating volume 016c2fd2-0328-4a12-aa22-83350aafe83c {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:38:58 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-016c2fd2-0328-4a12-aa22-83350aafe83c 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:58 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-016c2fd2-0328-4a12-aa22-83350aafe83c 1073741824 Aug 05 10:38:58 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:58 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-016c2fd2-0328-4a12-aa22-83350aafe83c 1073741824" returned: 0 in 0.491s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-016c2fd2-0328-4a12-aa22-83350aafe83c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:38:59 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-016c2fd2-0328-4a12-aa22-83350aafe83c Aug 05 10:38:59 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:38:59 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Aug 05 10:38:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-016c2fd2-0328-4a12-aa22-83350aafe83c" returned: 0 in 0.258s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:38:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:38:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:38:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caded2f4-8359-4688-a0dd-e4e3197e303b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-016c2fd2-0328-4a12-aa22-83350aafe83c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dee2e7d-c33a-482f-8f37-e13a72485183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:38:59 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Volume volume-016c2fd2-0328-4a12-aa22-83350aafe83c (016c2fd2-0328-4a12-aa22-83350aafe83c): created successfully Aug 05 10:38:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dee2e7d-c33a-482f-8f37-e13a72485183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:38:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Flow 'volume_create_manager' (cea03a01-7b5d-41fe-a98f-a3fd3c8d658c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:38:59 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-26e9430b-7d14-4fa1-80f8-fb9301b78413 tempest-VolumesGetTest-1120561712 None] Created volume successfully. Aug 05 10:39:00 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] Acquiring lock "cinder-016c2fd2-0328-4a12-aa22-83350aafe83c-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:00 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] Lock "cinder-016c2fd2-0328-4a12-aa22-83350aafe83c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:00 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] Acquiring lock "cinder-quobyte-016c2fd2-0328-4a12-aa22-83350aafe83c" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:00 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-016c2fd2-0328-4a12-aa22-83350aafe83c" acquired by "delete_volume" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:00 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[085579a1-12e6-4cc7-8b7b-dfd4f8c3ebe0]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-016c2fd2-0328-4a12-aa22-83350aafe83c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:00 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-016c2fd2-0328-4a12-aa22-83350aafe83c Aug 05 10:39:00 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:00 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-016c2fd2-0328-4a12-aa22-83350aafe83c" returned: 0 in 0.361s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-016c2fd2-0328-4a12-aa22-83350aafe83c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:01 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-016c2fd2-0328-4a12-aa22-83350aafe83c Aug 05 10:39:01 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:01 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-016c2fd2-0328-4a12-aa22-83350aafe83c" returned: 0 in 0.242s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-016c2fd2-0328-4a12-aa22-83350aafe83c" released by "delete_volume" :: held 0.644s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] Created reservations ['8fdda458-6621-4dec-aaf2-0645e9569a3f', '0937558c-04bf-4287-be8a-89c461f8c8e2', '26957959-f994-4750-b299-a3f857361bcd', 'a45c50d1-2807-4112-a43d-0f7c5c455080'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:01 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:39:01 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:01 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.238s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:39:01 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] Deleted volume successfully. Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6f7b1a57-4b67-4fee-8feb-09f22738c13c tempest-VolumesGetTest-1120561712 None] Lock "cinder-016c2fd2-0328-4a12-aa22-83350aafe83c-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] Acquiring lock "cinder-28934a19-94a6-4fb4-bbd8-fe855ff881c3-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] Lock "cinder-28934a19-94a6-4fb4-bbd8-fe855ff881c3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] Acquiring lock "cinder-quobyte-28934a19-94a6-4fb4-bbd8-fe855ff881c3" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-28934a19-94a6-4fb4-bbd8-fe855ff881c3" acquired by "delete_volume" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b668762b-7064-4c81-8672-5195670398a5]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28934a19-94a6-4fb4-bbd8-fe855ff881c3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:01 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28934a19-94a6-4fb4-bbd8-fe855ff881c3 Aug 05 10:39:01 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:02 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28934a19-94a6-4fb4-bbd8-fe855ff881c3" returned: 0 in 0.353s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28934a19-94a6-4fb4-bbd8-fe855ff881c3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:02 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28934a19-94a6-4fb4-bbd8-fe855ff881c3 Aug 05 10:39:02 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:02 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28934a19-94a6-4fb4-bbd8-fe855ff881c3" returned: 0 in 0.240s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-28934a19-94a6-4fb4-bbd8-fe855ff881c3" released by "delete_volume" :: held 0.631s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:02 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] Created reservations ['65feafb7-8881-4c23-bcb9-67ebc2f1bb6c', '4570784a-62b1-46c5-939d-e8a1bdcc588b', 'e8e0ea73-cde2-492d-9b54-adcdff72867f', '511a06ff-48df-41db-9666-61d1c7074d43'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:39:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:02 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:39:02 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:02 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.233s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:02 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:39:02 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] Deleted volume successfully. Aug 05 10:39:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7fef0d83-caaf-4748-a43b-00e1a0c9d06e tempest-VolumesGetTest-1120561712 None] Lock "cinder-28934a19-94a6-4fb4-bbd8-fe855ff881c3-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Flow 'volume_create_manager' (908adc1b-091a-4681-b7b3-0af287072ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb58fe4-f81c-4417-8c23-79ede287439f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb58fe4-f81c-4417-8c23-79ede287439f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1930726064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01b6b3a-55e7-4464-a073-797e8f9250d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61aac5dd4ef542f686de9ecaa6c0d37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:03Z,use_quota=True,user_id='71db3438cdc44647bb0fdad13c952db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a85cc11f-f347-4867-b370-5a4952a3258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a85cc11f-f347-4867-b370-5a4952a3258c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b70ed3f-66ec-4b66-a129-b98b1a497661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b70ed3f-66ec-4b66-a129-b98b1a497661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f01b6b3a-55e7-4464-a073-797e8f9250d1', 'volume_name': 'volume-f01b6b3a-55e7-4464-a073-797e8f9250d1', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a14497-81f8-4f52-a685-03059e540262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a14497-81f8-4f52-a685-03059e540262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (106ebb13-9ebe-4525-9426-5930b8bc66f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:03 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Volume f01b6b3a-55e7-4464-a073-797e8f9250d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f01b6b3a-55e7-4464-a073-797e8f9250d1', 'volume_size': 1} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1930726064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01b6b3a-55e7-4464-a073-797e8f9250d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61aac5dd4ef542f686de9ecaa6c0d37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:03Z,use_quota=True,user_id='71db3438cdc44647bb0fdad13c952db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Creating volume f01b6b3a-55e7-4464-a073-797e8f9250d1 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:39:03 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:03 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 1073741824 Aug 05 10:39:03 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:03 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 1073741824" returned: 0 in 0.424s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:03 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 Aug 05 10:39:03 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:04 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1" returned: 0 in 0.252s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (106ebb13-9ebe-4525-9426-5930b8bc66f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f01b6b3a-55e7-4464-a073-797e8f9250d1', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68fb8d01-2350-4aea-a7d7-1b4dafb7d30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:04 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Volume volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 (f01b6b3a-55e7-4464-a073-797e8f9250d1): created successfully Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68fb8d01-2350-4aea-a7d7-1b4dafb7d30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Flow 'volume_create_manager' (908adc1b-091a-4681-b7b3-0af287072ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:04 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a873412a-7f5e-42c1-9b77-31337be78869 tempest-VolumesGetTest-1120561712 None] Created volume successfully. Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Flow 'volume_create_manager' (96569ae8-1c05-4437-aff5-d826a4fb02a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3406d0ea-0193-4e8e-b3e4-ad1f96c88d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3406d0ea-0193-4e8e-b3e4-ad1f96c88d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1644327850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b10ad67-7108-4661-bf48-3afdc408a3ba,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61aac5dd4ef542f686de9ecaa6c0d37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f01b6b3a-55e7-4464-a073-797e8f9250d1,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:05Z,use_quota=True,user_id='71db3438cdc44647bb0fdad13c952db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5c1956-e575-4646-9ac3-14df52d4f474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5c1956-e575-4646-9ac3-14df52d4f474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78601450-8bcc-4799-ada2-7c47dfadbc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78601450-8bcc-4799-ada2-7c47dfadbc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9b10ad67-7108-4661-bf48-3afdc408a3ba', 'volume_name': 'volume-9b10ad67-7108-4661-bf48-3afdc408a3ba', 'volume_size': 1, 'source_volid': 'f01b6b3a-55e7-4464-a073-797e8f9250d1', 'source_volstatus': 'available'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be1a2b4-38d8-40de-bc2e-fa23e8e0db84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be1a2b4-38d8-40de-bc2e-fa23e8e0db84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418750ef-168a-4f38-8cef-3e1e7869b7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:04 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Volume 9b10ad67-7108-4661-bf48-3afdc408a3ba: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9b10ad67-7108-4661-bf48-3afdc408a3ba', 'volume_size': 1, 'source_volid': 'f01b6b3a-55e7-4464-a073-797e8f9250d1', 'source_volstatus': 'available'} Aug 05 10:39:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:05 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Cloning volume f01b6b3a-55e7-4464-a073-797e8f9250d1 to volume 9b10ad67-7108-4661-bf48-3afdc408a3ba Aug 05 10:39:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Creating offline snapshot 4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa of volume f01b6b3a-55e7-4464-a073-797e8f9250d1 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:39:05 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3d0747-f3df-4b93-910b-49ba5d23c616]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:05 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 Aug 05 10:39:05 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:05 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1" returned: 0 in 0.418s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:05 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa 1G Aug 05 10:39:05 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:06 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa 1G" returned: 0 in 0.483s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:06 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa Aug 05 10:39:06 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:06 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa" returned: 0 in 0.292s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:06 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa is being set with open permissions: ugo+rw Aug 05 10:39:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:06 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa Aug 05 10:39:06 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:06 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa" returned: 0 in 0.259s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:06 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.info Aug 05 10:39:06 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:06 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.info" returned: 0 in 0.274s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:06 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.info is being set with open permissions: ugo+rw Aug 05 10:39:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:06 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.info Aug 05 10:39:06 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:07 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.info" returned: 0 in 0.249s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Acquiring lock "cinder-quobyte-9b10ad67-7108-4661-bf48-3afdc408a3ba" by "_copy_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-9b10ad67-7108-4661-bf48-3afdc408a3ba" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] snapshot: 4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa, volume: 9b10ad67-7108-4661-bf48-3afdc408a3ba, {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1ddcee-1223-4ab6-a047-eb969594315a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:07 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa Aug 05 10:39:07 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:07 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa" returned: 0 in 0.346s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f01b6b3a-55e7-4464-a073-797e8f9250d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3e648b-e754-462b-ab30-a8612e82990f]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:07 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 Aug 05 10:39:07 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:07 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1" returned: 0 in 0.358s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] will copy from snapshot at /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Creating direct copy from snapshot {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG cinder.utils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Path /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9b10ad67-7108-4661-bf48-3afdc408a3ba not found in is_blk_device check {{(pid=88736) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:39:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9b10ad67-7108-4661-bf48-3afdc408a3ba {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:07 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9b10ad67-7108-4661-bf48-3afdc408a3ba Aug 05 10:39:07 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:11 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:39:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Flow 'volume_create_manager' (721c482c-4ceb-4dff-be22-4e3009e9a2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff52feb2-7888-48fe-98f8-a9fc85a4c341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff52feb2-7888-48fe-98f8-a9fc85a4c341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1101467526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6e8b20-3bb9-4698-870d-8c0f405c9f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660c40244e9b4d02ab480519c61fb582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:11Z,use_quota=True,user_id='e7e5fe653ba94cc7a50b9c7f72e037da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffeeac3-3ba9-4925-8f11-338c8979dff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffeeac3-3ba9-4925-8f11-338c8979dff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a458030c-c852-48ee-aaf6-5d85fcec8eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a458030c-c852-48ee-aaf6-5d85fcec8eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e6e8b20-3bb9-4698-870d-8c0f405c9f2b', 'volume_name': 'volume-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e6d561-56a9-4deb-831c-5d573aa8ce58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e6d561-56a9-4deb-831c-5d573aa8ce58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b781f3be-e11c-4b9f-a2cc-ff63eb105115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:11 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Volume 2e6e8b20-3bb9-4698-870d-8c0f405c9f2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b', 'volume_size': 1} Aug 05 10:39:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:12 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9b10ad67-7108-4661-bf48-3afdc408a3ba" returned: 0 in 4.732s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:12 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Image conversion details: src /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1, size 1024.00 MB, duration 4.73 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9b10ad67-7108-4661-bf48-3afdc408a3ba {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:39:12 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Converted 1024.00 MB image at 216.36 MB/s Aug 05 10:39:12 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9b10ad67-7108-4661-bf48-3afdc408a3ba is being set with open permissions: ugo+rw Aug 05 10:39:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9b10ad67-7108-4661-bf48-3afdc408a3ba {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:12 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9b10ad67-7108-4661-bf48-3afdc408a3ba Aug 05 10:39:12 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:12 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9b10ad67-7108-4661-bf48-3afdc408a3ba" returned: 0 in 0.246s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-9b10ad67-7108-4661-bf48-3afdc408a3ba" released by "_copy_volume_from_snapshot" :: held 5.747s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Acquiring lock "cinder-quobyte-4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Deleting offline snapshot 4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa of volume f01b6b3a-55e7-4464-a073-797e8f9250d1 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:39:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] snapshot_file for this snap is: volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:39:12 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[945986f2-11d0-416e-99b2-b8ac7190b9b5]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:13 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa Aug 05 10:39:13 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:13 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa" returned: 0 in 0.352s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f01b6b3a-55e7-4464-a073-797e8f9250d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:39:13 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd77674b-f03c-47f5-8879-870e2467cd7d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:13 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 Aug 05 10:39:13 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:39:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:13 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1" returned: 0 in 0.532s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:13 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:39:13 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:13 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa Aug 05 10:39:13 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:14 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.259s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:39:14 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa" returned: 0 in 0.333s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:14 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa Aug 05 10:39:14 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:14 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1.4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa" returned: 0 in 0.233s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-4dc84d6b-a88c-4e2a-9693-bfb7dcc79baa" released by "_delete_snapshot" :: held 1.536s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.495s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.356s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1101467526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6e8b20-3bb9-4698-870d-8c0f405c9f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660c40244e9b4d02ab480519c61fb582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:11Z,use_quota=True,user_id='e7e5fe653ba94cc7a50b9c7f72e037da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Creating volume 2e6e8b20-3bb9-4698-870d-8c0f405c9f2b {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:39:14 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:14 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b 1073741824 Aug 05 10:39:14 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418750ef-168a-4f38-8cef-3e1e7869b7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b10ad67-7108-4661-bf48-3afdc408a3ba', 'volume_size': 1, 'source_volid': 'f01b6b3a-55e7-4464-a073-797e8f9250d1', 'source_volstatus': 'available'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38a24cb-9dd1-4f32-b49f-c6ba3eb4b450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:14 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Volume volume-9b10ad67-7108-4661-bf48-3afdc408a3ba (9b10ad67-7108-4661-bf48-3afdc408a3ba): created successfully Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38a24cb-9dd1-4f32-b49f-c6ba3eb4b450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Flow 'volume_create_manager' (96569ae8-1c05-4437-aff5-d826a4fb02a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:14 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b6790026-6356-4f00-85e7-6e953fcd60cc tempest-VolumesGetTest-1120561712 None] Created volume successfully. Aug 05 10:39:15 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b 1073741824" returned: 0 in 0.480s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:15 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b Aug 05 10:39:15 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:15 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b" returned: 0 in 0.267s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b781f3be-e11c-4b9f-a2cc-ff63eb105115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf0ecc6-deb9-480f-a82e-e5253a752321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:15 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Volume volume-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b (2e6e8b20-3bb9-4698-870d-8c0f405c9f2b): created successfully Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf0ecc6-deb9-480f-a82e-e5253a752321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Flow 'volume_create_manager' (721c482c-4ceb-4dff-be22-4e3009e9a2f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:15 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8194ceaa-3f2d-4f5d-b91b-a4f0c26015c5 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Created volume successfully. Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Flow 'volume_create_manager' (495e9bd4-2027-46ec-b79d-9e9408afec2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69527415-90d3-42cd-b3e3-c376c3943cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69527415-90d3-42cd-b3e3-c376c3943cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-716046408',display_name='tempest-VolumesGetTest-Volume-1181816316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360e1a7c-3b7a-4a19-8cb0-9f21354891c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61aac5dd4ef542f686de9ecaa6c0d37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:15Z,use_quota=True,user_id='71db3438cdc44647bb0fdad13c952db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d31c7b5-9688-441a-866c-bf864fde2a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d31c7b5-9688-441a-866c-bf864fde2a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9e42e5-9146-476f-a214-b203b782f01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9e42e5-9146-476f-a214-b203b782f01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360e1a7c-3b7a-4a19-8cb0-9f21354891c8', 'volume_name': 'volume-360e1a7c-3b7a-4a19-8cb0-9f21354891c8', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc58fc6-8019-425f-ad2e-a7548a667913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc58fc6-8019-425f-ad2e-a7548a667913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe585fd-b73d-465f-8a18-8d565e488364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:15 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Volume 360e1a7c-3b7a-4a19-8cb0-9f21354891c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360e1a7c-3b7a-4a19-8cb0-9f21354891c8', 'volume_size': 1} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-716046408',display_name='tempest-VolumesGetTest-Volume-1181816316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360e1a7c-3b7a-4a19-8cb0-9f21354891c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61aac5dd4ef542f686de9ecaa6c0d37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:15Z,use_quota=True,user_id='71db3438cdc44647bb0fdad13c952db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Creating volume 360e1a7c-3b7a-4a19-8cb0-9f21354891c8 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:39:15 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-360e1a7c-3b7a-4a19-8cb0-9f21354891c8 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:15 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-360e1a7c-3b7a-4a19-8cb0-9f21354891c8 1073741824 Aug 05 10:39:15 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:15 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-360e1a7c-3b7a-4a19-8cb0-9f21354891c8 1073741824" returned: 0 in 0.415s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-360e1a7c-3b7a-4a19-8cb0-9f21354891c8 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:16 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-360e1a7c-3b7a-4a19-8cb0-9f21354891c8 Aug 05 10:39:16 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:16 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-360e1a7c-3b7a-4a19-8cb0-9f21354891c8" returned: 0 in 0.254s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe585fd-b73d-465f-8a18-8d565e488364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360e1a7c-3b7a-4a19-8cb0-9f21354891c8', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ff6107-87ac-4789-93c2-75a4f3483af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:16 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Volume volume-360e1a7c-3b7a-4a19-8cb0-9f21354891c8 (360e1a7c-3b7a-4a19-8cb0-9f21354891c8): created successfully Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ff6107-87ac-4789-93c2-75a4f3483af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Flow 'volume_create_manager' (495e9bd4-2027-46ec-b79d-9e9408afec2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:16 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-90ce6b7b-f076-484d-badf-57856ad8d558 tempest-VolumesGetTest-1120561712 None] Created volume successfully. Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] Acquiring lock "cinder-360e1a7c-3b7a-4a19-8cb0-9f21354891c8-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] Lock "cinder-360e1a7c-3b7a-4a19-8cb0-9f21354891c8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] Acquiring lock "cinder-quobyte-360e1a7c-3b7a-4a19-8cb0-9f21354891c8" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-360e1a7c-3b7a-4a19-8cb0-9f21354891c8" acquired by "delete_volume" :: waited 0.029s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[67071f1e-4b2e-47a7-a973-83aae46c3777]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-360e1a7c-3b7a-4a19-8cb0-9f21354891c8 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:16 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-360e1a7c-3b7a-4a19-8cb0-9f21354891c8 Aug 05 10:39:16 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-501c9870-570c-4a02-b1f0-a2320bbbeec4 req-c97b9d89-9e3f-4e46-8cc9-1ff8a4e20971 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-501c9870-570c-4a02-b1f0-a2320bbbeec4 req-c97b9d89-9e3f-4e46-8cc9-1ff8a4e20971 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-501c9870-570c-4a02-b1f0-a2320bbbeec4 req-c97b9d89-9e3f-4e46-8cc9-1ff8a4e20971 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:16 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-501c9870-570c-4a02-b1f0-a2320bbbeec4 req-c97b9d89-9e3f-4e46-8cc9-1ff8a4e20971 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ffa2b591-82c2-4b34-9ba0-fa726b87d9b1', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:39:17 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-501c9870-570c-4a02-b1f0-a2320bbbeec4 req-c97b9d89-9e3f-4e46-8cc9-1ff8a4e20971 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] attachment_update completed successfully. Aug 05 10:39:17 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-360e1a7c-3b7a-4a19-8cb0-9f21354891c8" returned: 0 in 0.369s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-360e1a7c-3b7a-4a19-8cb0-9f21354891c8 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:17 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-360e1a7c-3b7a-4a19-8cb0-9f21354891c8 Aug 05 10:39:17 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:17 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-360e1a7c-3b7a-4a19-8cb0-9f21354891c8" returned: 0 in 0.283s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-360e1a7c-3b7a-4a19-8cb0-9f21354891c8" released by "delete_volume" :: held 0.698s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] Created reservations ['7e819e9f-356a-4055-83c0-c20c64f71cc9', '5d0c95fe-4521-4378-92a0-1e09cb079f58', 'ba7769f0-16dc-4753-a1f2-5091ca5a1976', '0b120da4-c1d4-44ac-9214-1dcea643d0c8'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:17 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:39:17 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:17 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.311s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:39:17 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] Deleted volume successfully. Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6c94374c-d3cc-443c-9107-4a02a0d915fc tempest-VolumesGetTest-1120561712 None] Lock "cinder-360e1a7c-3b7a-4a19-8cb0-9f21354891c8-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] Acquiring lock "cinder-9b10ad67-7108-4661-bf48-3afdc408a3ba-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] Lock "cinder-9b10ad67-7108-4661-bf48-3afdc408a3ba-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] Acquiring lock "cinder-quobyte-9b10ad67-7108-4661-bf48-3afdc408a3ba" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-9b10ad67-7108-4661-bf48-3afdc408a3ba" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[23228e8e-736f-4997-b9c1-1cef9899885b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9b10ad67-7108-4661-bf48-3afdc408a3ba {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:18 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9b10ad67-7108-4661-bf48-3afdc408a3ba Aug 05 10:39:18 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:18 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9b10ad67-7108-4661-bf48-3afdc408a3ba" returned: 0 in 0.366s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9b10ad67-7108-4661-bf48-3afdc408a3ba {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:18 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9b10ad67-7108-4661-bf48-3afdc408a3ba Aug 05 10:39:18 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:18 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9b10ad67-7108-4661-bf48-3afdc408a3ba" returned: 0 in 0.238s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-9b10ad67-7108-4661-bf48-3afdc408a3ba" released by "delete_volume" :: held 0.654s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:18 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] Created reservations ['599ef9d1-52d6-4eb4-bedd-e16487c5f0bb', '65c00265-9e2f-4ca7-a26d-0d048808c69f', '22ed1c36-f101-46be-ac80-08a09f25a9dd', '6c317e17-8a1d-40b7-a628-05e66934cf08'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:39:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:18 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:39:18 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:18 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.253s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:18 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:39:18 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] Deleted volume successfully. Aug 05 10:39:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f226a9c7-e7b5-4678-9f1b-e92de725ae87 tempest-VolumesGetTest-1120561712 None] Lock "cinder-9b10ad67-7108-4661-bf48-3afdc408a3ba-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] Acquiring lock "cinder-f01b6b3a-55e7-4464-a073-797e8f9250d1-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] Lock "cinder-f01b6b3a-55e7-4464-a073-797e8f9250d1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] Acquiring lock "cinder-quobyte-f01b6b3a-55e7-4464-a073-797e8f9250d1" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-f01b6b3a-55e7-4464-a073-797e8f9250d1" acquired by "delete_volume" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:19 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecf143d-9db5-47da-a81b-e4419a2ac70c]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:19 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 Aug 05 10:39:19 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:19 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1" returned: 0 in 0.366s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:19 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1 Aug 05 10:39:19 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:19 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f01b6b3a-55e7-4464-a073-797e8f9250d1" returned: 0 in 0.271s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-f01b6b3a-55e7-4464-a073-797e8f9250d1" released by "delete_volume" :: held 0.709s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:19 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] Created reservations ['45a3da6e-3c4b-4b41-87aa-02350496bfd4', 'b4021153-f98f-47b6-ae83-72f8be8e2ad5', '9ce9aaaf-2a89-43f6-82a4-8c87b0c0faa9', '62def113-6aa3-4915-887c-036d5e114ad8'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:39:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:20 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:20 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:20 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:39:20 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:20 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.285s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:20 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:39:20 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] Deleted volume successfully. Aug 05 10:39:20 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-694a14ba-58d7-426b-9863-436914a1eac8 tempest-VolumesGetTest-1120561712 None] Lock "cinder-f01b6b3a-55e7-4464-a073-797e8f9250d1-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:20 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-a3574521-b4cb-4359-9687-3853f4fb6107 req-92294307-4536-486b-8f44-ed1d7ffb0176 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Terminate volume connection completed successfully. Aug 05 10:39:20 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-a3574521-b4cb-4359-9687-3853f4fb6107 req-92294307-4536-486b-8f44-ed1d7ffb0176 tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Deleting attachment ffa2b591-82c2-4b34-9ba0-fa726b87d9b1. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Flow 'volume_create_manager' (0bd832ba-0695-4521-92db-8f7deab75bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe81b80a-e18b-4d74-9713-7666bd1f9921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe81b80a-e18b-4d74-9713-7666bd1f9921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1180711785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2b849c-3ee9-4a46-b37c-520270cca13e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61aac5dd4ef542f686de9ecaa6c0d37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:21Z,use_quota=True,user_id='71db3438cdc44647bb0fdad13c952db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68ad154-34bb-420c-af35-0f4cee7c8327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68ad154-34bb-420c-af35-0f4cee7c8327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c3d215e-d0ad-4672-bd8f-ab9575439bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.image.glance [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Creating Keystone auth plugin from conf {{(pid=88736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Acquiring lock "cinder-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Lock "cinder-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Acquiring lock "cinder-quobyte-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Lock "cinder-quobyte-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b" acquired by "delete_volume" :: waited 0.027s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5588d17c-eaa7-4cc3-b1a7-a860c7132a17]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c3d215e-d0ad-4672-bd8f-ab9575439bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dc2b849c-3ee9-4a46-b37c-520270cca13e', 'volume_name': 'volume-dc2b849c-3ee9-4a46-b37c-520270cca13e', 'volume_size': 1, 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73179855073b4e3ea3fba8cb6e296bd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/619f1530-41da-4b56-a554-65c809c7c1ea/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ac408e-873a-4dc3-b933-67c7a85c9ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ac408e-873a-4dc3-b933-67c7a85c9ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07643b33-570b-427f-a35d-c618ca1754eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:21 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Volume dc2b849c-3ee9-4a46-b37c-520270cca13e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dc2b849c-3ee9-4a46-b37c-520270cca13e', 'volume_size': 1, 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73179855073b4e3ea3fba8cb6e296bd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/619f1530-41da-4b56-a554-65c809c7c1ea/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Trying to clone dc2b849c-3ee9-4a46-b37c-520270cca13e from image 619f1530-41da-4b56-a554-65c809c7c1ea at location (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]). {{(pid=88736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:39:21 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b Aug 05 10:39:21 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:21 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b" returned: 0 in 0.393s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:21 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b Aug 05 10:39:21 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_5rb3gl2vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:39:21 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Image download 20.69 MB at 20.69 MB/s Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1889a359-f97d-46a7-b17e-109dd5e1170b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_5rb3gl2vdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:22 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_5rb3gl2vdevstack@QuobyteHD Aug 05 10:39:22 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:22 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b" returned: 0 in 0.295s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Lock "cinder-quobyte-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b" released by "delete_volume" :: held 0.735s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Created reservations ['905fa4fd-47a2-466c-b43f-38e5d1564c0f', '0fb76429-9868-4d2d-b944-eff7729f2ca1', 'd7e7880e-27d1-4a5d-b2b6-db748e7bb429', 'b9b478a1-6a81-4b6e-b065-20a83943d502'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:22 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:39:22 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:22 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_5rb3gl2vdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Temporary image 619f1530-41da-4b56-a554-65c809c7c1ea is fetched for user 71db3438cdc44647bb0fdad13c952db2. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48baccd-e287-4794-9cf7-442efa2caec0]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_5rb3gl2vdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:22 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_5rb3gl2vdevstack@QuobyteHD Aug 05 10:39:22 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:22 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.271s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:39:22 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Deleted volume successfully. Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c7a43daa-7ec8-42d5-a5d3-7f9dbc1d053e tempest-TestServerVolumeAttachScenarioOldVersion-1008891159 None] Lock "cinder-2e6e8b20-3bb9-4698-870d-8c0f405c9f2b-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:22 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_5rb3gl2vdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1180711785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2b849c-3ee9-4a46-b37c-520270cca13e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61aac5dd4ef542f686de9ecaa6c0d37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:21Z,use_quota=True,user_id='71db3438cdc44647bb0fdad13c952db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Creating volume dc2b849c-3ee9-4a46-b37c-520270cca13e {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:39:22 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:39:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:22 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e 1073741824 Aug 05 10:39:22 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:23 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e 1073741824" returned: 0 in 0.614s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:23 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e Aug 05 10:39:23 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:23 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e" returned: 0 in 0.251s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:39:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:23 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Attempting download of 619f1530-41da-4b56-a554-65c809c7c1ea ((None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}])) to volume dc2b849c-3ee9-4a46-b37c-520270cca13e. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:39:23 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec20521a-b972-4a32-92a4-6e92a75eae86]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_ucgq_kbo {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:23 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_ucgq_kbo Aug 05 10:39:23 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:24 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_ucgq_kbo" returned: 0 in 0.376s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_ucgq_kbo {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:24 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_ucgq_kbo Aug 05 10:39:24 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:24 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_ucgq_kbo" returned: 1 in 0.354s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_ucgq_kbo' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:39:24 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5227abbc-b06b-4e22-84af-f6bf6d178722]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_5rb3gl2vdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:24 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_5rb3gl2vdevstack@QuobyteHD Aug 05 10:39:24 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:24 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_5rb3gl2vdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:24 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] 619f1530-41da-4b56-a554-65c809c7c1ea was qcow2, converting to qcow2 {{(pid=88736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:39:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_5rb3gl2vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:24 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_5rb3gl2vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e Aug 05 10:39:24 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:26 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_5rb3gl2vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e" returned: 0 in 1.772s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:26 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_5rb3gl2vdevstack@QuobyteHD, size 112.00 MB, duration 1.77 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:39:26 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Converted 112.00 MB image at 63.16 MB/s Aug 05 10:39:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:26 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e 1G Aug 05 10:39:26 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:27 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e 1G" returned: 0 in 0.365s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:27 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Downloaded image 619f1530-41da-4b56-a554-65c809c7c1ea ((None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}])) to volume dc2b849c-3ee9-4a46-b37c-520270cca13e successfully. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:39:27 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Temporary image 619f1530-41da-4b56-a554-65c809c7c1ea for user 71db3438cdc44647bb0fdad13c952db2 is deleted. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:39:27 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Marking volume dc2b849c-3ee9-4a46-b37c-520270cca13e as bootable. {{(pid=88736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:39:27 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Copying metadata from image 619f1530-41da-4b56-a554-65c809c7c1ea to dc2b849c-3ee9-4a46-b37c-520270cca13e. {{(pid=88736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:39:27 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Creating volume glance metadata for volume dc2b849c-3ee9-4a46-b37c-520270cca13e backed by image 619f1530-41da-4b56-a554-65c809c7c1ea with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:39:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07643b33-570b-427f-a35d-c618ca1754eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc2b849c-3ee9-4a46-b37c-520270cca13e', 'volume_size': 1, 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73179855073b4e3ea3fba8cb6e296bd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/619f1530-41da-4b56-a554-65c809c7c1ea/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df02a824-faa8-4436-82eb-56f144bc75bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:27 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Volume volume-dc2b849c-3ee9-4a46-b37c-520270cca13e (dc2b849c-3ee9-4a46-b37c-520270cca13e): created successfully Aug 05 10:39:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df02a824-faa8-4436-82eb-56f144bc75bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:27 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Flow 'volume_create_manager' (0bd832ba-0695-4521-92db-8f7deab75bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:27 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7ce03a4a-458d-41f2-b098-a7b394d2ddb4 tempest-VolumesGetTest-1120561712 None] Created volume successfully. Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Flow 'volume_create_manager' (ec99ca39-c263-4039-b87e-0935aea014b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc57a86-a008-41a7-b007-ec64d1854aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc57a86-a008-41a7-b007-ec64d1854aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-99289269',display_name='tempest-VolumesGetTest-Volume-42623897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861c3390-e2af-4464-b7c4-70339ada8803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61aac5dd4ef542f686de9ecaa6c0d37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:28Z,use_quota=True,user_id='71db3438cdc44647bb0fdad13c952db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b70f97-4a79-45ca-8f07-bd316ea5629d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b70f97-4a79-45ca-8f07-bd316ea5629d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a27f3b-01c3-4ea1-a4ca-e8a1f2460d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a27f3b-01c3-4ea1-a4ca-e8a1f2460d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '861c3390-e2af-4464-b7c4-70339ada8803', 'volume_name': 'volume-861c3390-e2af-4464-b7c4-70339ada8803', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c0b425-a6c9-4f3b-8b03-3db17d9c2510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c0b425-a6c9-4f3b-8b03-3db17d9c2510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9d425c-6b4b-48c2-be18-b32ed5cf2be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:28 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Volume 861c3390-e2af-4464-b7c4-70339ada8803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-861c3390-e2af-4464-b7c4-70339ada8803', 'volume_size': 1} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-99289269',display_name='tempest-VolumesGetTest-Volume-42623897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861c3390-e2af-4464-b7c4-70339ada8803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61aac5dd4ef542f686de9ecaa6c0d37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:28Z,use_quota=True,user_id='71db3438cdc44647bb0fdad13c952db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Creating volume 861c3390-e2af-4464-b7c4-70339ada8803 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:39:28 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-861c3390-e2af-4464-b7c4-70339ada8803 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:28 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-861c3390-e2af-4464-b7c4-70339ada8803 1073741824 Aug 05 10:39:28 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:28 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-861c3390-e2af-4464-b7c4-70339ada8803 1073741824" returned: 0 in 0.435s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-861c3390-e2af-4464-b7c4-70339ada8803 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:28 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-861c3390-e2af-4464-b7c4-70339ada8803 Aug 05 10:39:28 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:29 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-861c3390-e2af-4464-b7c4-70339ada8803" returned: 0 in 0.273s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:39:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9d425c-6b4b-48c2-be18-b32ed5cf2be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-861c3390-e2af-4464-b7c4-70339ada8803', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c9ece2-3941-42d3-a73f-7b652296afee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:29 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Volume volume-861c3390-e2af-4464-b7c4-70339ada8803 (861c3390-e2af-4464-b7c4-70339ada8803): created successfully Aug 05 10:39:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c9ece2-3941-42d3-a73f-7b652296afee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Flow 'volume_create_manager' (ec99ca39-c263-4039-b87e-0935aea014b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:29 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8ca9d0e2-7843-4529-805b-4b92717d71e8 tempest-VolumesGetTest-1120561712 None] Created volume successfully. Aug 05 10:39:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] Acquiring lock "cinder-861c3390-e2af-4464-b7c4-70339ada8803-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] Lock "cinder-861c3390-e2af-4464-b7c4-70339ada8803-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] Acquiring lock "cinder-quobyte-861c3390-e2af-4464-b7c4-70339ada8803" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-861c3390-e2af-4464-b7c4-70339ada8803" acquired by "delete_volume" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:30 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[506af977-9316-4e6c-a027-5a388ae1b025]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-861c3390-e2af-4464-b7c4-70339ada8803 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:30 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-861c3390-e2af-4464-b7c4-70339ada8803 Aug 05 10:39:30 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:30 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-861c3390-e2af-4464-b7c4-70339ada8803" returned: 0 in 0.376s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-861c3390-e2af-4464-b7c4-70339ada8803 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:30 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-861c3390-e2af-4464-b7c4-70339ada8803 Aug 05 10:39:30 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:31 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-861c3390-e2af-4464-b7c4-70339ada8803" returned: 0 in 0.262s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-861c3390-e2af-4464-b7c4-70339ada8803" released by "delete_volume" :: held 0.681s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] Created reservations ['63b5b072-7af8-4559-9cef-693b11e0c981', 'cac7e6bb-9e38-4d04-a77b-691965ec79c1', '72ad06b0-bf07-4948-bfc3-f8fbeccf741a', '705c75e1-658a-440e-a8b6-6a0ed73ded85'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:31 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:39:31 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:31 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.241s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:39:31 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] Deleted volume successfully. Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2d337567-42fe-428d-822e-5935abd058b2 tempest-VolumesGetTest-1120561712 None] Lock "cinder-861c3390-e2af-4464-b7c4-70339ada8803-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] Acquiring lock "cinder-dc2b849c-3ee9-4a46-b37c-520270cca13e-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] Lock "cinder-dc2b849c-3ee9-4a46-b37c-520270cca13e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] Acquiring lock "cinder-quobyte-dc2b849c-3ee9-4a46-b37c-520270cca13e" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-dc2b849c-3ee9-4a46-b37c-520270cca13e" acquired by "delete_volume" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5495a6-753f-46c7-9cd2-a172811a2a7e]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:31 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e Aug 05 10:39:31 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:32 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e" returned: 0 in 0.421s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:32 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e Aug 05 10:39:32 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:32 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-dc2b849c-3ee9-4a46-b37c-520270cca13e" returned: 0 in 0.263s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] Lock "cinder-quobyte-dc2b849c-3ee9-4a46-b37c-520270cca13e" released by "delete_volume" :: held 0.764s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:32 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] Created reservations ['1c85c4c4-b261-4446-b12e-00e910e12162', '3df17162-e52f-42f3-ba90-2fc8d428febe', '0512e908-1d8b-406a-bd75-cf3cce13eb77', 'fc370e71-4cf4-4020-b75d-9806dde378d4'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:39:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:32 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:39:32 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:32 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.321s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:32 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:39:32 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] Deleted volume successfully. Aug 05 10:39:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9e168d07-bafd-4b64-b3f3-c61874f5797f tempest-VolumesGetTest-1120561712 None] Lock "cinder-dc2b849c-3ee9-4a46-b37c-520270cca13e-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Flow 'volume_create_manager' (3f99fe29-428c-42cf-92f4-64adef685798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88026289-1faa-4190-a5c3-e2078d2c1be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88026289-1faa-4190-a5c3-e2078d2c1be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-647590268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f376d265-2e5d-46d2-bd1e-62c1f1d6a47d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5a8a52be53d4063acca84df0ef0f573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:36Z,use_quota=True,user_id='33ae5f377dd04882bd77adf5a3606e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ee77e9-033c-49a6-8c17-516fc7209af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ee77e9-033c-49a6-8c17-516fc7209af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81e63e6-c7a0-4376-8c6c-f8dcebefb0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81e63e6-c7a0-4376-8c6c-f8dcebefb0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f376d265-2e5d-46d2-bd1e-62c1f1d6a47d', 'volume_name': 'volume-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4eeb68-678b-484c-ae89-bd81b7b944a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4eeb68-678b-484c-ae89-bd81b7b944a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ed75ca-4064-4f3c-a1f3-02197ebf7414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:36 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Volume f376d265-2e5d-46d2-bd1e-62c1f1d6a47d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d', 'volume_size': 1} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-647590268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f376d265-2e5d-46d2-bd1e-62c1f1d6a47d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5a8a52be53d4063acca84df0ef0f573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:36Z,use_quota=True,user_id='33ae5f377dd04882bd77adf5a3606e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Creating volume f376d265-2e5d-46d2-bd1e-62c1f1d6a47d {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:39:36 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:36 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d 1073741824 Aug 05 10:39:36 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:36 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d 1073741824" returned: 0 in 0.453s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:36 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d Aug 05 10:39:36 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:36 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d" returned: 0 in 0.280s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ed75ca-4064-4f3c-a1f3-02197ebf7414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b12cd59-16d3-449a-b31d-8a68ca42345d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:37 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Volume volume-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d (f376d265-2e5d-46d2-bd1e-62c1f1d6a47d): created successfully Aug 05 10:39:37 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b12cd59-16d3-449a-b31d-8a68ca42345d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:37 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Flow 'volume_create_manager' (3f99fe29-428c-42cf-92f4-64adef685798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:37 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7ef4f45f-efdd-4c14-b5fb-47bab72daaa9 tempest-VolumesListTestJSON-1687297896 None] Created volume successfully. Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Flow 'volume_create_manager' (9338232b-3e80-4c5e-9ac3-294747f16075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f465b5-22e5-4ee9-9b01-69e3358274ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f465b5-22e5-4ee9-9b01-69e3358274ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-82622237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=056c3e04-8fb3-4909-b291-66e2a33f0c40,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5a8a52be53d4063acca84df0ef0f573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:39Z,use_quota=True,user_id='33ae5f377dd04882bd77adf5a3606e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4902bed1-b0c7-4de4-9cdb-1e474027ecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4902bed1-b0c7-4de4-9cdb-1e474027ecc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a17fff-0d93-48eb-a9aa-9d701b371754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a17fff-0d93-48eb-a9aa-9d701b371754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '056c3e04-8fb3-4909-b291-66e2a33f0c40', 'volume_name': 'volume-056c3e04-8fb3-4909-b291-66e2a33f0c40', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a33b54-cdb6-4a1c-ab99-5e76fc449b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a33b54-cdb6-4a1c-ab99-5e76fc449b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe60f68-42c9-4678-bc2e-74791a77de81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:38 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Volume 056c3e04-8fb3-4909-b291-66e2a33f0c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-056c3e04-8fb3-4909-b291-66e2a33f0c40', 'volume_size': 1} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-82622237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=056c3e04-8fb3-4909-b291-66e2a33f0c40,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5a8a52be53d4063acca84df0ef0f573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:39Z,use_quota=True,user_id='33ae5f377dd04882bd77adf5a3606e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Creating volume 056c3e04-8fb3-4909-b291-66e2a33f0c40 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:39:38 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:39:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-056c3e04-8fb3-4909-b291-66e2a33f0c40 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:38 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-056c3e04-8fb3-4909-b291-66e2a33f0c40 1073741824 Aug 05 10:39:38 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:39 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-056c3e04-8fb3-4909-b291-66e2a33f0c40 1073741824" returned: 0 in 0.479s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-056c3e04-8fb3-4909-b291-66e2a33f0c40 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:39 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-056c3e04-8fb3-4909-b291-66e2a33f0c40 Aug 05 10:39:39 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:39 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-056c3e04-8fb3-4909-b291-66e2a33f0c40" returned: 0 in 0.245s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:39:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe60f68-42c9-4678-bc2e-74791a77de81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-056c3e04-8fb3-4909-b291-66e2a33f0c40', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6166342-4a7c-43be-b78a-39d1fccd5d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:39 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Volume volume-056c3e04-8fb3-4909-b291-66e2a33f0c40 (056c3e04-8fb3-4909-b291-66e2a33f0c40): created successfully Aug 05 10:39:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6166342-4a7c-43be-b78a-39d1fccd5d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Flow 'volume_create_manager' (9338232b-3e80-4c5e-9ac3-294747f16075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:39 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-611d11c3-af16-4ffa-9d0c-317e260641e2 tempest-VolumesListTestJSON-1687297896 None] Created volume successfully. Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:INSERT=41,cinder:SELECT=108,cinder:DELETE=14,cinder:UPDATE=124 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=109,cinder:INSERT=42,cinder:UPDATE=139,cinder:DELETE=9 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Flow 'volume_create_manager' (e6ca2008-75f5-4f24-bf63-1f49d358adb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473e0616-1f45-4546-b8d1-f4f1f8f7bfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473e0616-1f45-4546-b8d1-f4f1f8f7bfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-68725384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c620d001-f1f8-4349-99d2-79790106d9ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5a8a52be53d4063acca84df0ef0f573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:40Z,use_quota=True,user_id='33ae5f377dd04882bd77adf5a3606e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d529b432-61c1-4405-874a-490159034472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d529b432-61c1-4405-874a-490159034472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb69d173-5c5e-4059-aa9a-c85f5b3d4d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb69d173-5c5e-4059-aa9a-c85f5b3d4d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c620d001-f1f8-4349-99d2-79790106d9ae', 'volume_name': 'volume-c620d001-f1f8-4349-99d2-79790106d9ae', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06ca4e3-e99c-4884-a973-23f0890718d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06ca4e3-e99c-4884-a973-23f0890718d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7178e29-4215-4ac6-b6d8-103c7f385fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:40 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Volume c620d001-f1f8-4349-99d2-79790106d9ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c620d001-f1f8-4349-99d2-79790106d9ae', 'volume_size': 1} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-68725384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c620d001-f1f8-4349-99d2-79790106d9ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5a8a52be53d4063acca84df0ef0f573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:40Z,use_quota=True,user_id='33ae5f377dd04882bd77adf5a3606e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Creating volume c620d001-f1f8-4349-99d2-79790106d9ae {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:39:40 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c620d001-f1f8-4349-99d2-79790106d9ae 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:40 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c620d001-f1f8-4349-99d2-79790106d9ae 1073741824 Aug 05 10:39:40 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:40 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c620d001-f1f8-4349-99d2-79790106d9ae 1073741824" returned: 0 in 0.513s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c620d001-f1f8-4349-99d2-79790106d9ae {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:40 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c620d001-f1f8-4349-99d2-79790106d9ae Aug 05 10:39:40 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:41 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c620d001-f1f8-4349-99d2-79790106d9ae" returned: 0 in 0.264s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:39:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7178e29-4215-4ac6-b6d8-103c7f385fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c620d001-f1f8-4349-99d2-79790106d9ae', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19e841f-5667-4fb7-8536-f3fe66438db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:41 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Volume volume-c620d001-f1f8-4349-99d2-79790106d9ae (c620d001-f1f8-4349-99d2-79790106d9ae): created successfully Aug 05 10:39:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19e841f-5667-4fb7-8536-f3fe66438db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Flow 'volume_create_manager' (e6ca2008-75f5-4f24-bf63-1f49d358adb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:41 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-3f4fed9a-eb61-497b-adf9-8d6c766e0488 tempest-VolumesListTestJSON-1687297896 None] Created volume successfully. Aug 05 10:39:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] Acquiring lock "cinder-c620d001-f1f8-4349-99d2-79790106d9ae-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] Lock "cinder-c620d001-f1f8-4349-99d2-79790106d9ae-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] Acquiring lock "cinder-quobyte-c620d001-f1f8-4349-99d2-79790106d9ae" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] Lock "cinder-quobyte-c620d001-f1f8-4349-99d2-79790106d9ae" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:44 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a789b6b-4f4f-4e65-b7e6-e88550dc3cb2]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c620d001-f1f8-4349-99d2-79790106d9ae {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:44 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c620d001-f1f8-4349-99d2-79790106d9ae Aug 05 10:39:44 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:45 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c620d001-f1f8-4349-99d2-79790106d9ae" returned: 0 in 0.406s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c620d001-f1f8-4349-99d2-79790106d9ae {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:45 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c620d001-f1f8-4349-99d2-79790106d9ae Aug 05 10:39:45 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:45 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c620d001-f1f8-4349-99d2-79790106d9ae" returned: 0 in 0.262s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:45 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] Lock "cinder-quobyte-c620d001-f1f8-4349-99d2-79790106d9ae" released by "delete_volume" :: held 0.728s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:45 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] Created reservations ['93534dca-4396-4984-8645-de157ca7b518', 'c417f0b4-e3f9-4a77-ae08-1ab068eeb505', 'fe99f18b-a5f5-49d8-849a-2a4b34b3ca23', '32118c94-56a4-4a69-a5aa-4d23953c8d08'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:39:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:45 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:39:45 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:45 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.287s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:45 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:39:45 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] Deleted volume successfully. Aug 05 10:39:45 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-777488a5-3268-4760-9f6e-e70eac31e2e1 tempest-VolumesListTestJSON-1687297896 None] Lock "cinder-c620d001-f1f8-4349-99d2-79790106d9ae-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:45 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] Acquiring lock "cinder-056c3e04-8fb3-4909-b291-66e2a33f0c40-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:45 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] Lock "cinder-056c3e04-8fb3-4909-b291-66e2a33f0c40-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] Acquiring lock "cinder-quobyte-056c3e04-8fb3-4909-b291-66e2a33f0c40" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] Lock "cinder-quobyte-056c3e04-8fb3-4909-b291-66e2a33f0c40" acquired by "delete_volume" :: waited 0.014s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:46 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb6749b-393f-442f-b283-9d0b93ca1088]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-056c3e04-8fb3-4909-b291-66e2a33f0c40 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:46 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-056c3e04-8fb3-4909-b291-66e2a33f0c40 Aug 05 10:39:46 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:46 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-056c3e04-8fb3-4909-b291-66e2a33f0c40" returned: 0 in 0.404s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-056c3e04-8fb3-4909-b291-66e2a33f0c40 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:46 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-056c3e04-8fb3-4909-b291-66e2a33f0c40 Aug 05 10:39:46 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:46 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-056c3e04-8fb3-4909-b291-66e2a33f0c40" returned: 0 in 0.275s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] Lock "cinder-quobyte-056c3e04-8fb3-4909-b291-66e2a33f0c40" released by "delete_volume" :: held 0.725s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:46 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] Created reservations ['06d0370b-e5df-402f-8f5c-8bc343006640', '0bfbd971-88b2-4e9b-be50-79161bdb0b1f', '700e3b19-ec4d-483b-9298-318f159114da', '9ee48c36-babb-47a7-b543-5d0573a98373'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:39:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:46 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:39:46 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:47 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.243s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:47 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:39:47 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] Deleted volume successfully. Aug 05 10:39:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6d91c2fb-44b3-4933-9be8-feae2d4e63e9 tempest-VolumesListTestJSON-1687297896 None] Lock "cinder-056c3e04-8fb3-4909-b291-66e2a33f0c40-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] Acquiring lock "cinder-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] Lock "cinder-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] Acquiring lock "cinder-quobyte-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] Lock "cinder-quobyte-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:47 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7df420-4203-42f7-987b-212ddeff7787]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:47 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d Aug 05 10:39:47 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:47 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d" returned: 0 in 0.382s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:47 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d Aug 05 10:39:47 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:47 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d" returned: 0 in 0.239s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] Lock "cinder-quobyte-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d" released by "delete_volume" :: held 0.679s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:48 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] Created reservations ['1d70181c-134b-4309-aafd-1b405f852ca2', '1a1af616-8096-4e4f-a4d7-2f98cbbabcb0', 'd5399c75-4a5d-4531-b95b-071ea82382b4', 'ec0a7744-faed-4ecf-a3af-ae598648a150'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:39:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:48 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:39:48 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:48 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.271s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:48 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:39:48 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] Deleted volume successfully. Aug 05 10:39:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3860514f-ef50-46fa-acd8-f1bbf6248f15 tempest-VolumesListTestJSON-1687297896 None] Lock "cinder-f376d265-2e5d-46d2-bd1e-62c1f1d6a47d-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Flow 'volume_create_manager' (3d0e8531-a690-4e2c-a073-087e2bd17b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a36638d-4233-443d-9e61-922d592aa113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a36638d-4233-443d-9e61-922d592aa113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1984265107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0b315a-40a9-4721-9098-ef1c1dc99274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa525c3fa994062bef975a89841a49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:52Z,use_quota=True,user_id='59f8d336b5bf40dca07368a7252b88da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894fe977-ca6a-41f6-be14-d6e18620567a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894fe977-ca6a-41f6-be14-d6e18620567a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf93ec78-0467-4935-adfa-98a261698848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf93ec78-0467-4935-adfa-98a261698848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de0b315a-40a9-4721-9098-ef1c1dc99274', 'volume_name': 'volume-de0b315a-40a9-4721-9098-ef1c1dc99274', 'volume_size': 2}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f983e2d-bd12-4404-89e0-400cc29bac7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f983e2d-bd12-4404-89e0-400cc29bac7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3e4715-dd41-44c8-89a3-ef9a968922a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:51 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Volume de0b315a-40a9-4721-9098-ef1c1dc99274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de0b315a-40a9-4721-9098-ef1c1dc99274', 'volume_size': 2} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1984265107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0b315a-40a9-4721-9098-ef1c1dc99274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa525c3fa994062bef975a89841a49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:52Z,use_quota=True,user_id='59f8d336b5bf40dca07368a7252b88da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Creating volume de0b315a-40a9-4721-9098-ef1c1dc99274 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:39:51 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:39:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274 2147483648 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:51 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274 2147483648 Aug 05 10:39:51 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:52 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274 2147483648" returned: 0 in 0.581s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:52 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274 Aug 05 10:39:52 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:52 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274" returned: 0 in 0.289s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:39:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3e4715-dd41-44c8-89a3-ef9a968922a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de0b315a-40a9-4721-9098-ef1c1dc99274', 'volume_size': 2}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857d0ce1-6aa6-4b1e-9c1f-6889fa4e2477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:52 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Volume volume-de0b315a-40a9-4721-9098-ef1c1dc99274 (de0b315a-40a9-4721-9098-ef1c1dc99274): created successfully Aug 05 10:39:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857d0ce1-6aa6-4b1e-9c1f-6889fa4e2477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Flow 'volume_create_manager' (3d0e8531-a690-4e2c-a073-087e2bd17b5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:52 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7dd96ad2-32cb-45df-81e4-cff90fa4870b tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Created volume successfully. Aug 05 10:39:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Creating offline snapshot 2ab0fb28-d300-4178-a24d-2ca8251c2f66 of volume de0b315a-40a9-4721-9098-ef1c1dc99274 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:39:53 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abe8ec7-cc47-4491-b2b4-336bccc1686c]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:54 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274 Aug 05 10:39:54 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:54 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274" returned: 0 in 0.379s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66 2G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:54 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66 2G Aug 05 10:39:54 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:54 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66 2G" returned: 0 in 0.464s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0b315a-40a9-4721-9098-ef1c1dc99274 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:54 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0b315a-40a9-4721-9098-ef1c1dc99274 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66 Aug 05 10:39:54 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:55 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0b315a-40a9-4721-9098-ef1c1dc99274 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66" returned: 0 in 0.317s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:55 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66 is being set with open permissions: ugo+rw Aug 05 10:39:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:55 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66 Aug 05 10:39:55 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:55 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66" returned: 0 in 0.270s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:55 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.info Aug 05 10:39:55 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:55 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.info" returned: 0 in 0.255s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:55 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.info is being set with open permissions: ugo+rw Aug 05 10:39:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:55 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.info Aug 05 10:39:55 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:55 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.info" returned: 0 in 0.253s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.046s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:56 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-9467266c-38e0-4973-a028-b61ae5601d2f tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Create snapshot completed successfully Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Flow 'volume_create_manager' (2723a875-9f5e-4635-8f8d-f4fb7cd06d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79209bf1-b95f-4f03-a5c4-8a2465756cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79209bf1-b95f-4f03-a5c4-8a2465756cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-184276440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c9be84-b1ef-4f07-982e-eae6fb4e8f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e55d7b30284cc8b1a48e110c2d54e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:57Z,use_quota=True,user_id='d7442910b8484443ba0ac57262b1327a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f0ea9d-3706-42b3-b558-e9fb7d86667a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f0ea9d-3706-42b3-b558-e9fb7d86667a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b225ea8-5ea6-42ba-bdca-eb363feb71c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b225ea8-5ea6-42ba-bdca-eb363feb71c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c9be84-b1ef-4f07-982e-eae6fb4e8f2b', 'volume_name': 'volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18805e2f-f5ed-4f21-a16a-b26172b03a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18805e2f-f5ed-4f21-a16a-b26172b03a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9045ad75-9f9c-4140-bd20-510d0ec38146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:56 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Volume 56c9be84-b1ef-4f07-982e-eae6fb4e8f2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b', 'volume_size': 1} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-184276440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c9be84-b1ef-4f07-982e-eae6fb4e8f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e55d7b30284cc8b1a48e110c2d54e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:39:57Z,use_quota=True,user_id='d7442910b8484443ba0ac57262b1327a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Creating volume 56c9be84-b1ef-4f07-982e-eae6fb4e8f2b {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:39:56 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:39:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:56 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b 1073741824 Aug 05 10:39:56 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Acquiring lock "cinder-2ab0fb28-d300-4178-a24d-2ca8251c2f66-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "cinder-2ab0fb28-d300-4178-a24d-2ca8251c2f66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Acquiring lock "cinder-quobyte-de0b315a-40a9-4721-9098-ef1c1dc99274" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "cinder-quobyte-de0b315a-40a9-4721-9098-ef1c1dc99274" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Acquiring lock "cinder-quobyte-2ab0fb28-d300-4178-a24d-2ca8251c2f66" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "cinder-quobyte-2ab0fb28-d300-4178-a24d-2ca8251c2f66" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Deleting offline snapshot 2ab0fb28-d300-4178-a24d-2ca8251c2f66 of volume de0b315a-40a9-4721-9098-ef1c1dc99274 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] snapshot_file for this snap is: volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[af42f399-7a02-4ecf-8726-1f3f1a74138a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:57 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b 1073741824" returned: 0 in 0.517s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:57 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66 Aug 05 10:39:57 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:57 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b Aug 05 10:39:57 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:57 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b" returned: 0 in 0.251s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9045ad75-9f9c-4140-bd20-510d0ec38146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1b3ac3-4f86-46e6-8ddb-9859e824f118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:39:57 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Volume volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b (56c9be84-b1ef-4f07-982e-eae6fb4e8f2b): created successfully Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1b3ac3-4f86-46e6-8ddb-9859e824f118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Flow 'volume_create_manager' (2723a875-9f5e-4635-8f8d-f4fb7cd06d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:39:57 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66" returned: 0 in 0.480s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0b315a-40a9-4721-9098-ef1c1dc99274(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:39:57 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-0b5c8851-9d01-4146-a731-81d0d5debfd5 tempest-TestStampPattern-207283409 None] Created volume successfully. Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[389fb2de-2548-4a46-9341-2f6932735f76]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:57 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274 Aug 05 10:39:57 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:58 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274" returned: 0 in 0.419s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:58 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66 Aug 05 10:39:58 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:58 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66" returned: 0 in 0.362s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:58 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66 Aug 05 10:39:58 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:39:58 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Aug 05 10:39:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274.2ab0fb28-d300-4178-a24d-2ca8251c2f66" returned: 0 in 0.263s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:39:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "cinder-quobyte-2ab0fb28-d300-4178-a24d-2ca8251c2f66" released by "_delete_snapshot" :: held 1.659s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "cinder-quobyte-de0b315a-40a9-4721-9098-ef1c1dc99274" released by "delete_snapshot" :: held 1.681s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:59 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Created reservations ['3602cefe-6422-4e98-91ce-94852250ec28', '10c67ce3-c310-4af6-a2c3-f465b0e12f91', '06f41744-10a7-4971-abec-6bd541a7a302', '57734844-eb82-4168-956f-63aa361cea9f'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:39:59 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Delete snapshot completed successfully. Aug 05 10:39:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-07e01947-768a-4192-9f8e-f99caa1db251 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "cinder-2ab0fb28-d300-4178-a24d-2ca8251c2f66-delete_snapshot" released by "delete_snapshot" :: held 1.856s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:39:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Acquiring lock "cinder-de0b315a-40a9-4721-9098-ef1c1dc99274-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "cinder-de0b315a-40a9-4721-9098-ef1c1dc99274-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Acquiring lock "cinder-quobyte-de0b315a-40a9-4721-9098-ef1c1dc99274" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:39:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "cinder-quobyte-de0b315a-40a9-4721-9098-ef1c1dc99274" acquired by "delete_volume" :: waited 0.027s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:39:59 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[113d8946-774c-4818-b444-379877d95058]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:39:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:39:59 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274 Aug 05 10:39:59 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:00 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274" returned: 0 in 0.480s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:40:00 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274 Aug 05 10:40:00 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:00 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-de0b315a-40a9-4721-9098-ef1c1dc99274" returned: 0 in 0.297s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:00 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "cinder-quobyte-de0b315a-40a9-4721-9098-ef1c1dc99274" released by "delete_volume" :: held 0.850s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:40:00 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Created reservations ['5149b50c-ae47-4441-865d-308dd0cfbf5e', '6eb03a20-7d46-490c-94eb-938ef25334d4', 'a0078ad5-b08d-4c90-b566-86ad87269e3d', 'ba04640b-f2d9-4a19-aa32-9775dcbbfce2'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:40:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:40:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:40:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:40:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:40:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:40:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:40:00 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:40:00 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:00 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.303s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:00 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:40:00 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Deleted volume successfully. Aug 05 10:40:00 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9657672b-0594-4f23-bfa9-5f1628bdf7d5 tempest-VolumesSnapshotNegativeTestJSON-1425358937 None] Lock "cinder-de0b315a-40a9-4721-9098-ef1c1dc99274-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:40:10 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=44,cinder:INSERT=11,cinder:UPDATE=40,cinder:DELETE=4 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:40:10 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:UPDATE=56,cinder:DELETE=4,cinder:SELECT=26,cinder:INSERT=13 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:40:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:40:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:40:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:40:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:40:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:40:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:40:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:40:13 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:40:13 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:14 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.301s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:40:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:40:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:40:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Flow 'volume_create_manager' (e1b2fd59-305d-4141-aa52-ea5efddb8b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0948578-cbc6-4daa-bcbb-9e674f96aaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0948578-cbc6-4daa-bcbb-9e674f96aaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1311113226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b7a1740-10e7-49e7-bf8c-2928b5207d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5f13295ab34510acd978ccc3ee4edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:40:22Z,use_quota=True,user_id='759ef7fcf30a42b396082972261968bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca69089-c568-4e77-b02e-3ff7892eab1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca69089-c568-4e77-b02e-3ff7892eab1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6de28f-02e7-4361-aad1-c745aab50e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6de28f-02e7-4361-aad1-c745aab50e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b7a1740-10e7-49e7-bf8c-2928b5207d85', 'volume_name': 'volume-0b7a1740-10e7-49e7-bf8c-2928b5207d85', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154d82e3-13bf-4950-b93e-4c45304bd5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154d82e3-13bf-4950-b93e-4c45304bd5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6fdd60-1666-41ac-aefb-e7dcaebee4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:21 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Volume 0b7a1740-10e7-49e7-bf8c-2928b5207d85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b7a1740-10e7-49e7-bf8c-2928b5207d85', 'volume_size': 1} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1311113226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b7a1740-10e7-49e7-bf8c-2928b5207d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5f13295ab34510acd978ccc3ee4edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:40:22Z,use_quota=True,user_id='759ef7fcf30a42b396082972261968bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Creating volume 0b7a1740-10e7-49e7-bf8c-2928b5207d85 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:40:21 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:40:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b7a1740-10e7-49e7-bf8c-2928b5207d85 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:40:21 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b7a1740-10e7-49e7-bf8c-2928b5207d85 1073741824 Aug 05 10:40:21 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Flow 'volume_create_manager' (581a5a23-0923-4f81-b451-5aa50f715355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18078a11-8f72-4458-87ad-00b1b457bf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18078a11-8f72-4458-87ad-00b1b457bf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-827962491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3edeb2-d3f2-44bc-b08c-8f8c41a25958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5f13295ab34510acd978ccc3ee4edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:40:22Z,use_quota=True,user_id='759ef7fcf30a42b396082972261968bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe1075f-9d79-4cce-8ebb-f384e8fd6016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe1075f-9d79-4cce-8ebb-f384e8fd6016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ee24c1-41b2-4372-82a4-cb828cc5d8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ee24c1-41b2-4372-82a4-cb828cc5d8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e3edeb2-d3f2-44bc-b08c-8f8c41a25958', 'volume_name': 'volume-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0995b651-0066-4f6b-9b16-6d927f9950e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0995b651-0066-4f6b-9b16-6d927f9950e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6697ea0-70fc-4033-80af-cacd52790a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:22 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Volume 5e3edeb2-d3f2-44bc-b08c-8f8c41a25958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958', 'volume_size': 1} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:40:22 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b7a1740-10e7-49e7-bf8c-2928b5207d85 1073741824" returned: 0 in 0.559s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b7a1740-10e7-49e7-bf8c-2928b5207d85 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:40:22 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b7a1740-10e7-49e7-bf8c-2928b5207d85 Aug 05 10:40:22 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:22 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b7a1740-10e7-49e7-bf8c-2928b5207d85" returned: 0 in 0.285s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.497s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-827962491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3edeb2-d3f2-44bc-b08c-8f8c41a25958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5f13295ab34510acd978ccc3ee4edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:40:22Z,use_quota=True,user_id='759ef7fcf30a42b396082972261968bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Creating volume 5e3edeb2-d3f2-44bc-b08c-8f8c41a25958 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:40:22 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:40:22 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958 1073741824 Aug 05 10:40:22 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6fdd60-1666-41ac-aefb-e7dcaebee4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b7a1740-10e7-49e7-bf8c-2928b5207d85', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a75677f-1d77-4644-8b10-b4b977a3a3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:22 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Volume volume-0b7a1740-10e7-49e7-bf8c-2928b5207d85 (0b7a1740-10e7-49e7-bf8c-2928b5207d85): created successfully Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a75677f-1d77-4644-8b10-b4b977a3a3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Flow 'volume_create_manager' (e1b2fd59-305d-4141-aa52-ea5efddb8b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:40:22 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c35f652c-1ba6-469f-a8f1-b140b20a4cab tempest-TestServerVolumeAttachmentScenario-2036893733 None] Created volume successfully. Aug 05 10:40:23 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958 1073741824" returned: 0 in 0.564s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:40:23 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958 Aug 05 10:40:23 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:23 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958" returned: 0 in 0.278s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:40:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:40:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6697ea0-70fc-4033-80af-cacd52790a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a73654-bf15-4888-a29b-cf67c24ce956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:23 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Volume volume-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958 (5e3edeb2-d3f2-44bc-b08c-8f8c41a25958): created successfully Aug 05 10:40:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a73654-bf15-4888-a29b-cf67c24ce956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Flow 'volume_create_manager' (581a5a23-0923-4f81-b451-5aa50f715355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:40:23 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-937402ef-e361-457a-a399-716d7499247a tempest-TestServerVolumeAttachmentScenario-2036893733 None] Created volume successfully. Aug 05 10:40:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-8841e72d-59f8-4f61-a4bf-e17e445a4699 req-45adb1e9-18da-4f05-9f8d-2f5d7e48272d tempest-TestStampPattern-207283409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:40:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-8841e72d-59f8-4f61-a4bf-e17e445a4699 req-45adb1e9-18da-4f05-9f8d-2f5d7e48272d tempest-TestStampPattern-207283409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:40:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-8841e72d-59f8-4f61-a4bf-e17e445a4699 req-45adb1e9-18da-4f05-9f8d-2f5d7e48272d tempest-TestStampPattern-207283409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:40:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-8841e72d-59f8-4f61-a4bf-e17e445a4699 req-45adb1e9-18da-4f05-9f8d-2f5d7e48272d tempest-TestStampPattern-207283409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f061e803-2dac-4c1d-b51b-9aa22f6c80f7', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:40:29 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-8841e72d-59f8-4f61-a4bf-e17e445a4699 req-45adb1e9-18da-4f05-9f8d-2f5d7e48272d tempest-TestStampPattern-207283409 None] attachment_update completed successfully. Aug 05 10:40:34 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-549916dc-604b-438f-a485-fc70f86ae38a req-11123975-a9ed-4400-a0fd-7dd2bd53d218 tempest-TestStampPattern-207283409 None] Terminate volume connection completed successfully. Aug 05 10:40:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-549916dc-604b-438f-a485-fc70f86ae38a req-11123975-a9ed-4400-a0fd-7dd2bd53d218 tempest-TestStampPattern-207283409 None] Deleting attachment f061e803-2dac-4c1d-b51b-9aa22f6c80f7. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:40:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:40:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:40:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] Creating offline snapshot d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 of volume 56c9be84-b1ef-4f07-982e-eae6fb4e8f2b {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:40:35 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6aa9182-8443-415e-b98b-69de1dc8c9f0]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:40:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:40:35 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b Aug 05 10:40:35 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:36 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b" returned: 0 in 0.369s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:40:36 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 1G Aug 05 10:40:36 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:36 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 1G" returned: 0 in 0.379s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:40:36 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 Aug 05 10:40:36 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:36 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6" returned: 0 in 0.321s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:36 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 is being set with open permissions: ugo+rw Aug 05 10:40:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:40:36 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 Aug 05 10:40:36 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:37 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6" returned: 0 in 0.245s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:40:37 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.info Aug 05 10:40:37 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:37 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.info" returned: 0 in 0.261s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:37 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.info is being set with open permissions: ugo+rw Aug 05 10:40:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:40:37 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.info Aug 05 10:40:37 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:37 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.info" returned: 0 in 0.238s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:40:37 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a64a50f3-b037-44af-81e3-eb92f3b02aa9 tempest-TestStampPattern-207283409 None] Create snapshot completed successfully Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Flow 'volume_create_manager' (469a40fb-dd61-4621-b31c-506001b3bc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100b926b-6c21-4974-b293-516632b3c2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100b926b-6c21-4974-b293-516632b3c2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-302632714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fcb770c-6a76-4aa4-a476-7c86f53eb42a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e55d7b30284cc8b1a48e110c2d54e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:40:45Z,use_quota=True,user_id='d7442910b8484443ba0ac57262b1327a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e4f249-015a-4255-990e-f2c70277e143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e4f249-015a-4255-990e-f2c70277e143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30842d5b-913c-47b5-accf-428eadf230c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30842d5b-913c-47b5-accf-428eadf230c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2fcb770c-6a76-4aa4-a476-7c86f53eb42a', 'volume_name': 'volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a', 'volume_size': 1, 'snapshot_id': 'd7a75a9c-42ef-4d9a-a8a4-726ccaa63de6'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b744c3-5145-44ae-9de2-f8ff3adfa980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b744c3-5145-44ae-9de2-f8ff3adfa980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949c1f32-c45a-4741-bd0e-22872b0fdc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:44 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Volume 2fcb770c-6a76-4aa4-a476-7c86f53eb42a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a', 'volume_size': 1, 'snapshot_id': 'd7a75a9c-42ef-4d9a-a8a4-726ccaa63de6'} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Acquiring lock "cinder-quobyte-d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6-2fcb770c-6a76-4aa4-a476-7c86f53eb42a" by "_create_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Lock "cinder-quobyte-d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6-2fcb770c-6a76-4aa4-a476-7c86f53eb42a" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Creating volume 2fcb770c-6a76-4aa4-a476-7c86f53eb42a from snapshot d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 {{(pid=88736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Acquiring lock "cinder-quobyte-2fcb770c-6a76-4aa4-a476-7c86f53eb42a" by "_copy_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Lock "cinder-quobyte-2fcb770c-6a76-4aa4-a476-7c86f53eb42a" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] snapshot: d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6, volume: 2fcb770c-6a76-4aa4-a476-7c86f53eb42a, {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae75de39-2208-4870-aa99-b09e5ccc0ada]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:40:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:40:44 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 Aug 05 10:40:44 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:45 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6" returned: 0 in 0.372s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:40:45 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[edccf1fd-8936-4f9d-97e5-f55382310d00]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:40:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:40:45 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b Aug 05 10:40:45 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:45 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b" returned: 0 in 0.407s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] will copy from snapshot at /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:40:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Creating direct copy from snapshot {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:40:45 devstack cinder-volume[88736]: DEBUG cinder.utils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Path /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a not found in is_blk_device check {{(pid=88736) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:40:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:40:45 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a Aug 05 10:40:45 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:51 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a" returned: 0 in 6.068s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:51 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Image conversion details: src /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:40:51 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Converted 1024.00 MB image at 168.73 MB/s Aug 05 10:40:51 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a is being set with open permissions: ugo+rw Aug 05 10:40:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:40:51 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a Aug 05 10:40:51 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:40:52 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Aug 05 10:40:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a" returned: 0 in 0.374s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:40:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Lock "cinder-quobyte-2fcb770c-6a76-4aa4-a476-7c86f53eb42a" released by "_copy_volume_from_snapshot" :: held 7.318s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:40:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Lock "cinder-quobyte-d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6-2fcb770c-6a76-4aa4-a476-7c86f53eb42a" released by "_create_volume_from_snapshot" :: held 7.433s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:40:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.451s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:40:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949c1f32-c45a-4741-bd0e-22872b0fdc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a', 'volume_size': 1, 'snapshot_id': 'd7a75a9c-42ef-4d9a-a8a4-726ccaa63de6'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c22533-e27f-4cd4-9e94-f58a312589ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:40:52 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Volume volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a (2fcb770c-6a76-4aa4-a476-7c86f53eb42a): created successfully Aug 05 10:40:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c22533-e27f-4cd4-9e94-f58a312589ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:40:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Flow 'volume_create_manager' (469a40fb-dd61-4621-b31c-506001b3bc3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:40:52 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-318769f0-7d30-4e2d-a3ca-2350cc7866f1 tempest-TestStampPattern-207283409 None] Created volume successfully. Aug 05 10:40:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-875d7e4e-37a0-4cda-aa0c-07546704755e req-95607204-43df-4fde-b2d5-d94f038fca65 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:40:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-875d7e4e-37a0-4cda-aa0c-07546704755e req-95607204-43df-4fde-b2d5-d94f038fca65 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:40:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-875d7e4e-37a0-4cda-aa0c-07546704755e req-95607204-43df-4fde-b2d5-d94f038fca65 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:40:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-875d7e4e-37a0-4cda-aa0c-07546704755e req-95607204-43df-4fde-b2d5-d94f038fca65 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-0b7a1740-10e7-49e7-bf8c-2928b5207d85', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f2d30e2-c738-4162-a42e-5c536ad65fe2', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:40:56 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-875d7e4e-37a0-4cda-aa0c-07546704755e req-95607204-43df-4fde-b2d5-d94f038fca65 tempest-TestServerVolumeAttachmentScenario-2036893733 None] attachment_update completed successfully. Aug 05 10:41:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-fdecae1f-f8cf-429f-bbb2-0827bca528db req-0fa0312b-e3a1-4d17-b752-97bb61d48897 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-fdecae1f-f8cf-429f-bbb2-0827bca528db req-0fa0312b-e3a1-4d17-b752-97bb61d48897 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-fdecae1f-f8cf-429f-bbb2-0827bca528db req-0fa0312b-e3a1-4d17-b752-97bb61d48897 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-fdecae1f-f8cf-429f-bbb2-0827bca528db req-0fa0312b-e3a1-4d17-b752-97bb61d48897 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0de79453-ec12-46c1-a767-4e21f7a3b62b', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:41:01 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-fdecae1f-f8cf-429f-bbb2-0827bca528db req-0fa0312b-e3a1-4d17-b752-97bb61d48897 tempest-TestServerVolumeAttachmentScenario-2036893733 None] attachment_update completed successfully. Aug 05 10:41:02 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-5a882aa0-2321-4610-be71-6f030c1ab268 req-fa01ca68-26ce-4cb9-8fb9-7c7889f89769 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Terminate volume connection completed successfully. Aug 05 10:41:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-5a882aa0-2321-4610-be71-6f030c1ab268 req-fa01ca68-26ce-4cb9-8fb9-7c7889f89769 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Deleting attachment 0de79453-ec12-46c1-a767-4e21f7a3b62b. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:41:04 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-20a53860-332a-479e-99c7-a37334caaacf req-f0601303-8df9-4c2d-8bed-e7f602305c98 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Terminate volume connection completed successfully. Aug 05 10:41:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-20a53860-332a-479e-99c7-a37334caaacf req-f0601303-8df9-4c2d-8bed-e7f602305c98 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Deleting attachment 8f2d30e2-c738-4162-a42e-5c536ad65fe2. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:41:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Acquiring lock "cinder-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:41:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "cinder-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:41:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Acquiring lock "cinder-quobyte-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:41:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "cinder-quobyte-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:41:10 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d4feaf-a45c-4114-92c6-c8cf7f36d7e8]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:41:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:10 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958 Aug 05 10:41:10 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:10 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958" returned: 0 in 0.369s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:10 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958 Aug 05 10:41:10 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:10 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958" returned: 0 in 0.243s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "cinder-quobyte-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958" released by "delete_volume" :: held 0.650s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:41:10 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Created reservations ['778dc923-a699-4cfe-97f9-8f9431e3b3bc', '2f372d0f-6dc8-49df-97bc-8c3d16b954c3', '83d84960-8c99-45d4-a339-fc6352f4e490', 'e98176dc-f84f-44a9-af61-21e110e43dca'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:41:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:41:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:41:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:10 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:41:10 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:10 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.243s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:10 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:41:11 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Deleted volume successfully. Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5892cbd8-2252-4497-9e54-78b2ac356ed7 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "cinder-5e3edeb2-d3f2-44bc-b08c-8f8c41a25958-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Acquiring lock "cinder-0b7a1740-10e7-49e7-bf8c-2928b5207d85-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "cinder-0b7a1740-10e7-49e7-bf8c-2928b5207d85-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Acquiring lock "cinder-quobyte-0b7a1740-10e7-49e7-bf8c-2928b5207d85" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "cinder-quobyte-0b7a1740-10e7-49e7-bf8c-2928b5207d85" acquired by "delete_volume" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[12750cfe-ccf9-47bc-b99e-d6299176a30a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b7a1740-10e7-49e7-bf8c-2928b5207d85 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:11 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b7a1740-10e7-49e7-bf8c-2928b5207d85 Aug 05 10:41:11 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:11 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b7a1740-10e7-49e7-bf8c-2928b5207d85" returned: 0 in 0.351s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b7a1740-10e7-49e7-bf8c-2928b5207d85 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:11 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b7a1740-10e7-49e7-bf8c-2928b5207d85 Aug 05 10:41:11 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:11 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0b7a1740-10e7-49e7-bf8c-2928b5207d85" returned: 0 in 0.241s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "cinder-quobyte-0b7a1740-10e7-49e7-bf8c-2928b5207d85" released by "delete_volume" :: held 0.627s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Created reservations ['ac0dc0c9-a78d-4638-92f8-f2ec6cb91b1d', 'ffc1998b-a3c9-48c9-9d87-c356eec2d4cd', '7ce098e0-4390-4ab0-9377-6f22b908d316', '4b397b92-2060-4ab7-ad43-0368b3ad6d36'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:11 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:41:11 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:12 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.243s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:12 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:41:12 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Deleted volume successfully. Aug 05 10:41:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-24d15ebd-170a-4884-aa13-bd51de03cd51 tempest-TestServerVolumeAttachmentScenario-2036893733 None] Lock "cinder-0b7a1740-10e7-49e7-bf8c-2928b5207d85-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:41:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:41:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:41:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:41:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:13 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:41:13 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:14 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.259s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:41:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:41:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:41:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:41:21 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:UPDATE=30,cinder:SELECT=48,cinder:INSERT=6,cinder:DELETE=3 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:41:22 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=39,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=3 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:41:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-0888201c-ca26-49bd-bda6-56a487d3e31b req-77849f60-38aa-4b71-828b-46eb2c094b0c tempest-TestStampPattern-207283409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-0888201c-ca26-49bd-bda6-56a487d3e31b req-77849f60-38aa-4b71-828b-46eb2c094b0c tempest-TestStampPattern-207283409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-0888201c-ca26-49bd-bda6-56a487d3e31b req-77849f60-38aa-4b71-828b-46eb2c094b0c tempest-TestStampPattern-207283409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-0888201c-ca26-49bd-bda6-56a487d3e31b req-77849f60-38aa-4b71-828b-46eb2c094b0c tempest-TestStampPattern-207283409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a55e7483-f478-4a63-9471-263b3a593ae8', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:41:23 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-0888201c-ca26-49bd-bda6-56a487d3e31b req-77849f60-38aa-4b71-828b-46eb2c094b0c tempest-TestStampPattern-207283409 None] attachment_update completed successfully. Aug 05 10:41:26 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-32584e68-f453-489f-8ad1-37e009c5471c req-b999730b-5983-4254-862f-aa58d1de9cce tempest-TestStampPattern-207283409 None] Terminate volume connection completed successfully. Aug 05 10:41:26 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-32584e68-f453-489f-8ad1-37e009c5471c req-b999730b-5983-4254-862f-aa58d1de9cce tempest-TestStampPattern-207283409 None] Deleting attachment a55e7483-f478-4a63-9471-263b3a593ae8. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:41:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] Acquiring lock "cinder-2fcb770c-6a76-4aa4-a476-7c86f53eb42a-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:41:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] Lock "cinder-2fcb770c-6a76-4aa4-a476-7c86f53eb42a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:41:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] Acquiring lock "cinder-quobyte-2fcb770c-6a76-4aa4-a476-7c86f53eb42a" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:41:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] Lock "cinder-quobyte-2fcb770c-6a76-4aa4-a476-7c86f53eb42a" acquired by "delete_volume" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:41:31 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5c6d0d-a547-4496-9465-266ac600e6ef]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:41:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:31 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a Aug 05 10:41:31 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:31 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a" returned: 0 in 0.444s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:31 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a Aug 05 10:41:31 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:31 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2fcb770c-6a76-4aa4-a476-7c86f53eb42a" returned: 0 in 0.267s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] Lock "cinder-quobyte-2fcb770c-6a76-4aa4-a476-7c86f53eb42a" released by "delete_volume" :: held 0.782s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:41:31 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] Created reservations ['c5daf7b3-88b1-405a-a93e-4972a46b1b31', '5ff6bc43-b01b-44d9-833b-804f8930b677', '1897ae69-5bae-4cc4-b8bb-2b1aff1b7cc6', '4ac68540-9a7b-49e9-8649-c3d8f93a9acf'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:41:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:41:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:41:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:32 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:41:32 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:32 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.274s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:32 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:41:32 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] Deleted volume successfully. Aug 05 10:41:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e56a5a70-47ca-4807-a7cb-1405c654bfda tempest-TestStampPattern-207283409 None] Lock "cinder-2fcb770c-6a76-4aa4-a476-7c86f53eb42a-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:41:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] Acquiring lock "cinder-d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:41:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] Lock "cinder-d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:41:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] Acquiring lock "cinder-quobyte-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:41:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] Lock "cinder-quobyte-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:41:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] Acquiring lock "cinder-quobyte-d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:41:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] Lock "cinder-quobyte-d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:41:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] Deleting offline snapshot d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 of volume 56c9be84-b1ef-4f07-982e-eae6fb4e8f2b {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:41:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] snapshot_file for this snap is: volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:41:32 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[473c8955-523c-4d67-8936-346626d72bfb]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:41:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:32 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 Aug 05 10:41:32 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:32 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6" returned: 0 in 0.397s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:41:33 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5a7df8-49e2-41be-8563-34afa9315ed3]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:41:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:33 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b Aug 05 10:41:33 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:33 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b" returned: 0 in 0.549s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:33 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 Aug 05 10:41:33 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:33 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6" returned: 0 in 0.405s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:34 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6 Aug 05 10:41:34 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:34 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b.d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6" returned: 0 in 0.288s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] Lock "cinder-quobyte-d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6" released by "_delete_snapshot" :: held 1.752s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:41:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] Lock "cinder-quobyte-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b" released by "delete_snapshot" :: held 1.778s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:41:34 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] Created reservations ['9b505fb6-59d4-4e0e-a451-a5084af325ea', '64ac8496-3ab5-48da-9d29-27acdf07996a', '09e52898-8834-439d-9aab-b72f2a976dd7', '1d0b06c6-7f04-435c-8151-61a151598961'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:41:34 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] Delete snapshot completed successfully. Aug 05 10:41:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-1dba9668-8785-464e-b871-99d7275c5ac0 tempest-TestStampPattern-207283409 None] Lock "cinder-d7a75a9c-42ef-4d9a-a8a4-726ccaa63de6-delete_snapshot" released by "delete_snapshot" :: held 1.929s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:41:38 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] Acquiring lock "cinder-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:41:38 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] Lock "cinder-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:41:38 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] Acquiring lock "cinder-quobyte-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:41:38 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] Lock "cinder-quobyte-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:41:38 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d1831b-18de-4bad-b28f-628d03e72ba2]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:41:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:38 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b Aug 05 10:41:38 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:39 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b" returned: 0 in 0.481s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:39 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b Aug 05 10:41:39 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:39 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b" returned: 0 in 0.260s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] Lock "cinder-quobyte-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b" released by "delete_volume" :: held 0.827s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:41:39 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] Created reservations ['30012534-4ce6-42ca-bc95-afbb4291bd1a', '75916675-111c-4533-a167-8a400a2e584e', '4a7b9b21-325a-4320-8005-9234d2086895', 'e68d65d5-b3b0-4909-bcb2-f6d76e7fcd44'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:41:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:41:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:41:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:39 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:41:39 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:39 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.284s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:39 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:41:39 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] Deleted volume successfully. Aug 05 10:41:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-33c7b7f1-53a2-49d1-9c44-8c59b402bbc9 tempest-TestStampPattern-207283409 None] Lock "cinder-56c9be84-b1ef-4f07-982e-eae6fb4e8f2b-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:41:44 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:41:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Flow 'volume_create_manager' (0fb90650-185e-4094-aefc-5d1363935747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:41:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f822b4b-bc7f-40f7-aa46-e519a22f943f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f822b4b-bc7f-40f7-aa46-e519a22f943f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-661435821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614407cd-88e1-4654-ad75-9387d3545c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa0de259a5f4ea29dc6df97654b97f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:41:44Z,use_quota=True,user_id='bbc12705fad44b6a8ab60de42ecb0d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477eaad3-98bb-4559-b7d2-6659934b7b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477eaad3-98bb-4559-b7d2-6659934b7b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff4bf72-7eb9-43d1-92b9-f464ce87e166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:44 devstack cinder-volume[88736]: DEBUG cinder.image.glance [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Creating Keystone auth plugin from conf {{(pid=88736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:41:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff4bf72-7eb9-43d1-92b9-f464ce87e166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '614407cd-88e1-4654-ad75-9387d3545c76', 'volume_name': 'volume-614407cd-88e1-4654-ad75-9387d3545c76', 'volume_size': 1, 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73179855073b4e3ea3fba8cb6e296bd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/619f1530-41da-4b56-a554-65c809c7c1ea/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2acc49-e3f6-4edc-8654-0c7df85da92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2acc49-e3f6-4edc-8654-0c7df85da92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776f4f18-1563-42e5-844c-e6408062d83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:45 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Volume 614407cd-88e1-4654-ad75-9387d3545c76: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-614407cd-88e1-4654-ad75-9387d3545c76', 'volume_size': 1, 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73179855073b4e3ea3fba8cb6e296bd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/619f1530-41da-4b56-a554-65c809c7c1ea/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 10:41:45 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Trying to clone 614407cd-88e1-4654-ad75-9387d3545c76 from image 619f1530-41da-4b56-a554-65c809c7c1ea at location (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]). {{(pid=88736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:41:45 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_8820m4ijdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:41:45 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Image download 20.69 MB at 20.69 MB/s Aug 05 10:41:45 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a300d648-4fa5-48a7-9cf1-824c78fb898d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:41:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_8820m4ijdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:45 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_8820m4ijdevstack@QuobyteHD Aug 05 10:41:45 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:45 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_8820m4ijdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:45 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Temporary image 619f1530-41da-4b56-a554-65c809c7c1ea is fetched for user bbc12705fad44b6a8ab60de42ecb0d6a. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:41:45 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6162a33d-19d5-4cbc-9361-c0d1bdf13939]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:41:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_8820m4ijdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:45 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_8820m4ijdevstack@QuobyteHD Aug 05 10:41:45 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:46 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_8820m4ijdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-661435821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614407cd-88e1-4654-ad75-9387d3545c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa0de259a5f4ea29dc6df97654b97f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:41:44Z,use_quota=True,user_id='bbc12705fad44b6a8ab60de42ecb0d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Creating volume 614407cd-88e1-4654-ad75-9387d3545c76 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:41:46 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:46 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76 1073741824 Aug 05 10:41:46 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:46 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76 1073741824" returned: 0 in 0.462s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:46 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76 Aug 05 10:41:46 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:46 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76" returned: 0 in 0.261s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:46 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Attempting download of 619f1530-41da-4b56-a554-65c809c7c1ea ((None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}])) to volume 614407cd-88e1-4654-ad75-9387d3545c76. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:41:47 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3083be5-1aee-422d-afb2-66fc3238c0a1]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:41:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_59rq6pao {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:47 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_59rq6pao Aug 05 10:41:47 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:47 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_59rq6pao" returned: 0 in 0.337s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_59rq6pao {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:47 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_59rq6pao Aug 05 10:41:47 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_59rq6pao" returned: 1 in 0.350s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_619f1530-41da-4b56-a554-65c809c7c1ea_59rq6pao' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:41:47 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:47 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91ef3c7-2d2e-470a-9dfd-f9c8ba39dc59]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:41:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_8820m4ijdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:47 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_8820m4ijdevstack@QuobyteHD Aug 05 10:41:47 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:48 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_8820m4ijdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:48 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] 619f1530-41da-4b56-a554-65c809c7c1ea was qcow2, converting to qcow2 {{(pid=88736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:41:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_8820m4ijdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:48 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_8820m4ijdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76 Aug 05 10:41:48 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:49 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_8820m4ijdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76" returned: 0 in 1.808s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:49 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_619f1530-41da-4b56-a554-65c809c7c1ea_8820m4ijdevstack@QuobyteHD, size 112.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76 {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:41:49 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Converted 112.00 MB image at 61.90 MB/s Aug 05 10:41:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:49 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76 1G Aug 05 10:41:49 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:50 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76 1G" returned: 0 in 0.357s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:50 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Downloaded image 619f1530-41da-4b56-a554-65c809c7c1ea ((None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}])) to volume 614407cd-88e1-4654-ad75-9387d3545c76 successfully. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:41:50 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Temporary image 619f1530-41da-4b56-a554-65c809c7c1ea for user bbc12705fad44b6a8ab60de42ecb0d6a is deleted. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:41:50 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Marking volume 614407cd-88e1-4654-ad75-9387d3545c76 as bootable. {{(pid=88736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:41:50 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Copying metadata from image 619f1530-41da-4b56-a554-65c809c7c1ea to 614407cd-88e1-4654-ad75-9387d3545c76. {{(pid=88736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:41:50 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Creating volume glance metadata for volume 614407cd-88e1-4654-ad75-9387d3545c76 backed by image 619f1530-41da-4b56-a554-65c809c7c1ea with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:41:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776f4f18-1563-42e5-844c-e6408062d83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-614407cd-88e1-4654-ad75-9387d3545c76', 'volume_size': 1, 'image_id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/619f1530-41da-4b56-a554-65c809c7c1ea', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73179855073b4e3ea3fba8cb6e296bd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '619f1530-41da-4b56-a554-65c809c7c1ea', 'created_at': datetime.datetime(2026, 8, 5, 8, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 19, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/619f1530-41da-4b56-a554-65c809c7c1ea/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270e8ce0-ef55-4e27-a2d2-e38096115c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:50 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Volume volume-614407cd-88e1-4654-ad75-9387d3545c76 (614407cd-88e1-4654-ad75-9387d3545c76): created successfully Aug 05 10:41:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270e8ce0-ef55-4e27-a2d2-e38096115c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Flow 'volume_create_manager' (0fb90650-185e-4094-aefc-5d1363935747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:41:50 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ebbe139b-83c9-4df8-a582-3aff515375ec tempest-TestShelveInstance-446779605 None] Created volume successfully. Aug 05 10:41:51 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Flow 'volume_create_manager' (7326929a-2aca-4972-8d16-2d39c4fe89c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7e9147-8ac2-4a0a-9013-e6488b7270fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7e9147-8ac2-4a0a-9013-e6488b7270fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-687980685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa87989b-73fb-4e0e-942f-a3d329d0810d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bef090f3fcb9479283c4292247693b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:41:52Z,use_quota=True,user_id='a80be340d8654fddbc1693e726ccbd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4263ee2-8d65-4f63-89ea-2036df62b85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4263ee2-8d65-4f63-89ea-2036df62b85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd63974-94ad-440c-b573-8e755e37b2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd63974-94ad-440c-b573-8e755e37b2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa87989b-73fb-4e0e-942f-a3d329d0810d', 'volume_name': 'volume-fa87989b-73fb-4e0e-942f-a3d329d0810d', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63be7ab0-afdf-48cf-8962-0ed5b5785b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63be7ab0-afdf-48cf-8962-0ed5b5785b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4b0cc7-0813-4541-8df3-682ab72827eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:52 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Volume fa87989b-73fb-4e0e-942f-a3d329d0810d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa87989b-73fb-4e0e-942f-a3d329d0810d', 'volume_size': 1} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-687980685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa87989b-73fb-4e0e-942f-a3d329d0810d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bef090f3fcb9479283c4292247693b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:41:52Z,use_quota=True,user_id='a80be340d8654fddbc1693e726ccbd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Creating volume fa87989b-73fb-4e0e-942f-a3d329d0810d {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:41:52 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fa87989b-73fb-4e0e-942f-a3d329d0810d 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:52 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fa87989b-73fb-4e0e-942f-a3d329d0810d 1073741824 Aug 05 10:41:52 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Flow 'volume_create_manager' (76a9130d-f302-47ac-9357-d1752516f2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ff82e2-2891-4b7e-820e-e139d5b1d9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ff82e2-2891-4b7e-820e-e139d5b1d9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-99406231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038b78b0-d3bf-4fc8-b2cc-353ea1437d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bef090f3fcb9479283c4292247693b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:41:53Z,use_quota=True,user_id='a80be340d8654fddbc1693e726ccbd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab6edb3-218e-44fe-babd-74c489826122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab6edb3-218e-44fe-babd-74c489826122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9d1b36-1850-4b63-a5e2-baa0c96db356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9d1b36-1850-4b63-a5e2-baa0c96db356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '038b78b0-d3bf-4fc8-b2cc-353ea1437d42', 'volume_name': 'volume-038b78b0-d3bf-4fc8-b2cc-353ea1437d42', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b82031-8195-4f8b-84fa-60987530d505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b82031-8195-4f8b-84fa-60987530d505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c211dd1e-2c11-4496-ac4e-d5b447bcbc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:52 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Volume 038b78b0-d3bf-4fc8-b2cc-353ea1437d42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-038b78b0-d3bf-4fc8-b2cc-353ea1437d42', 'volume_size': 1} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:52 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fa87989b-73fb-4e0e-942f-a3d329d0810d 1073741824" returned: 0 in 0.630s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fa87989b-73fb-4e0e-942f-a3d329d0810d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:52 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fa87989b-73fb-4e0e-942f-a3d329d0810d Aug 05 10:41:52 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:52 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Flow 'volume_create_manager' (b1a29f44-2ab9-4022-b386-00ef5cffcaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444859f4-65dc-4599-87ba-d1dc2f873bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444859f4-65dc-4599-87ba-d1dc2f873bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-935886003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98c1249-62a5-42fe-a2d7-1e4f6fb2383e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bef090f3fcb9479283c4292247693b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:41:53Z,use_quota=True,user_id='a80be340d8654fddbc1693e726ccbd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb92da65-a258-46cc-9240-3ca5addb7296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb92da65-a258-46cc-9240-3ca5addb7296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48451ae2-7b24-4486-880d-018d865d4953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48451ae2-7b24-4486-880d-018d865d4953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e98c1249-62a5-42fe-a2d7-1e4f6fb2383e', 'volume_name': 'volume-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b668bcd-0814-43a0-b681-da817da556cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b668bcd-0814-43a0-b681-da817da556cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b166db3-e65b-48be-bd20-e6ad1fc0e2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:53 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Volume e98c1249-62a5-42fe-a2d7-1e4f6fb2383e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e', 'volume_size': 1} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:53 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fa87989b-73fb-4e0e-942f-a3d329d0810d" returned: 0 in 0.350s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.398s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-99406231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038b78b0-d3bf-4fc8-b2cc-353ea1437d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bef090f3fcb9479283c4292247693b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:41:53Z,use_quota=True,user_id='a80be340d8654fddbc1693e726ccbd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Creating volume 038b78b0-d3bf-4fc8-b2cc-353ea1437d42 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:41:53 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-038b78b0-d3bf-4fc8-b2cc-353ea1437d42 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4b0cc7-0813-4541-8df3-682ab72827eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa87989b-73fb-4e0e-942f-a3d329d0810d', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:53 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-038b78b0-d3bf-4fc8-b2cc-353ea1437d42 1073741824 Aug 05 10:41:53 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638a9f19-00f4-4fbb-a73c-0df1bcfb4981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:53 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Volume volume-fa87989b-73fb-4e0e-942f-a3d329d0810d (fa87989b-73fb-4e0e-942f-a3d329d0810d): created successfully Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638a9f19-00f4-4fbb-a73c-0df1bcfb4981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Flow 'volume_create_manager' (7326929a-2aca-4972-8d16-2d39c4fe89c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:41:53 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ebaadfad-ea2c-4658-aed2-bedda929750b tempest-CreateVolumesFromImageTest-999843810 None] Created volume successfully. Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Flow 'volume_create_manager' (5634f741-19c4-4539-8d9f-b144b905f708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a53a469-3ae6-4976-bbcf-8a3c15b48183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a53a469-3ae6-4976-bbcf-8a3c15b48183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1269855251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a75f097-93fe-4faf-bbbf-3cc5f7f426e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bef090f3fcb9479283c4292247693b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:41:53Z,use_quota=True,user_id='a80be340d8654fddbc1693e726ccbd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96faa16-3dac-4a13-90ce-0116f13ebd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96faa16-3dac-4a13-90ce-0116f13ebd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6649cdfc-98f5-461a-870a-d73710b69dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6649cdfc-98f5-461a-870a-d73710b69dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a75f097-93fe-4faf-bbbf-3cc5f7f426e2', 'volume_name': 'volume-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b95383-a999-4429-9fd3-6db09b754efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b95383-a999-4429-9fd3-6db09b754efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c223aa93-d96c-447c-ab23-ce3c0c91a4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:53 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Volume 9a75f097-93fe-4faf-bbbf-3cc5f7f426e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2', 'volume_size': 1} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:53 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-038b78b0-d3bf-4fc8-b2cc-353ea1437d42 1073741824" returned: 0 in 0.699s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-057adbfb-6ab7-48d1-acad-12f91c31d706 req-7c53afc0-9482-4fe7-a654-47d98b33a806 tempest-TestShelveInstance-446779605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-038b78b0-d3bf-4fc8-b2cc-353ea1437d42 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:53 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-038b78b0-d3bf-4fc8-b2cc-353ea1437d42 Aug 05 10:41:53 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Flow 'volume_create_manager' (abfa6cd7-ce15-4095-ae7b-f276ea29a014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505e37f7-b143-46b7-9fa9-0ce3c832bce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505e37f7-b143-46b7-9fa9-0ce3c832bce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1491796108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df18b03-ad06-4999-895c-ca29514ccee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bef090f3fcb9479283c4292247693b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:41:54Z,use_quota=True,user_id='a80be340d8654fddbc1693e726ccbd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e252050c-0eaf-401a-a31a-a5336f3e2253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e252050c-0eaf-401a-a31a-a5336f3e2253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea50498-4ba7-4162-b520-bdf03bd768c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea50498-4ba7-4162-b520-bdf03bd768c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9df18b03-ad06-4999-895c-ca29514ccee1', 'volume_name': 'volume-9df18b03-ad06-4999-895c-ca29514ccee1', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1303840f-6dcb-4b80-9ce5-41752256d771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1303840f-6dcb-4b80-9ce5-41752256d771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1674e7d6-6dc2-4d8f-b86b-9f387a6bfa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:54 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Volume 9df18b03-ad06-4999-895c-ca29514ccee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9df18b03-ad06-4999-895c-ca29514ccee1', 'volume_size': 1} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-038b78b0-d3bf-4fc8-b2cc-353ea1437d42" returned: 0 in 0.315s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:54 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.160s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-935886003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98c1249-62a5-42fe-a2d7-1e4f6fb2383e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bef090f3fcb9479283c4292247693b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:41:53Z,use_quota=True,user_id='a80be340d8654fddbc1693e726ccbd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Creating volume e98c1249-62a5-42fe-a2d7-1e4f6fb2383e {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:41:54 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c211dd1e-2c11-4496-ac4e-d5b447bcbc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038b78b0-d3bf-4fc8-b2cc-353ea1437d42', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de21713e-c34c-4654-97a2-b6a2d4899a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:54 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e 1073741824 Aug 05 10:41:54 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:54 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Volume volume-038b78b0-d3bf-4fc8-b2cc-353ea1437d42 (038b78b0-d3bf-4fc8-b2cc-353ea1437d42): created successfully Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de21713e-c34c-4654-97a2-b6a2d4899a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Flow 'volume_create_manager' (76a9130d-f302-47ac-9357-d1752516f2fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:41:54 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-09b85f52-ed9b-40b1-9774-fbe93ace0953 tempest-CreateVolumesFromImageTest-999843810 None] Created volume successfully. Aug 05 10:41:54 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e 1073741824" returned: 0 in 0.561s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:54 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e Aug 05 10:41:54 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:55 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e" returned: 0 in 0.265s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.527s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1269855251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a75f097-93fe-4faf-bbbf-3cc5f7f426e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bef090f3fcb9479283c4292247693b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:41:53Z,use_quota=True,user_id='a80be340d8654fddbc1693e726ccbd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Creating volume 9a75f097-93fe-4faf-bbbf-3cc5f7f426e2 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:41:55 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b166db3-e65b-48be-bd20-e6ad1fc0e2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:55 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2 1073741824 Aug 05 10:41:55 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7617f1b8-364d-49b9-883a-3519c8df451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:55 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Volume volume-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e (e98c1249-62a5-42fe-a2d7-1e4f6fb2383e): created successfully Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7617f1b8-364d-49b9-883a-3519c8df451b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Flow 'volume_create_manager' (b1a29f44-2ab9-4022-b386-00ef5cffcaae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:41:55 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a61c5b24-97e0-44a3-b121-1332aac515eb tempest-CreateVolumesFromImageTest-999843810 None] Created volume successfully. Aug 05 10:41:55 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2 1073741824" returned: 0 in 0.483s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:55 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2 Aug 05 10:41:55 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:55 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2" returned: 0 in 0.272s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-057adbfb-6ab7-48d1-acad-12f91c31d706 req-7c53afc0-9482-4fe7-a654-47d98b33a806 tempest-TestShelveInstance-446779605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.046s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-057adbfb-6ab7-48d1-acad-12f91c31d706 req-7c53afc0-9482-4fe7-a654-47d98b33a806 tempest-TestShelveInstance-446779605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.864s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1491796108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df18b03-ad06-4999-895c-ca29514ccee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bef090f3fcb9479283c4292247693b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:41:54Z,use_quota=True,user_id='a80be340d8654fddbc1693e726ccbd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Creating volume 9df18b03-ad06-4999-895c-ca29514ccee1 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:41:55 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:41:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9df18b03-ad06-4999-895c-ca29514ccee1 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c223aa93-d96c-447c-ab23-ce3c0c91a4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff30dbb-6b32-446a-9c15-eb1af33be2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:56 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9df18b03-ad06-4999-895c-ca29514ccee1 1073741824 Aug 05 10:41:56 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:56 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Volume volume-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2 (9a75f097-93fe-4faf-bbbf-3cc5f7f426e2): created successfully Aug 05 10:41:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff30dbb-6b32-446a-9c15-eb1af33be2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Flow 'volume_create_manager' (5634f741-19c4-4539-8d9f-b144b905f708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:41:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-057adbfb-6ab7-48d1-acad-12f91c31d706 req-7c53afc0-9482-4fe7-a654-47d98b33a806 tempest-TestShelveInstance-446779605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-614407cd-88e1-4654-ad75-9387d3545c76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c54c3c9a-a015-4501-a61c-8358e5a52714', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:41:56 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-89bd77c0-f0c8-408b-ba04-9b5e3c6b87ff tempest-CreateVolumesFromImageTest-999843810 None] Created volume successfully. Aug 05 10:41:56 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-057adbfb-6ab7-48d1-acad-12f91c31d706 req-7c53afc0-9482-4fe7-a654-47d98b33a806 tempest-TestShelveInstance-446779605 None] attachment_update completed successfully. Aug 05 10:41:56 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9df18b03-ad06-4999-895c-ca29514ccee1 1073741824" returned: 0 in 0.554s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9df18b03-ad06-4999-895c-ca29514ccee1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:56 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9df18b03-ad06-4999-895c-ca29514ccee1 Aug 05 10:41:56 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:56 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9df18b03-ad06-4999-895c-ca29514ccee1" returned: 0 in 0.376s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:41:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1674e7d6-6dc2-4d8f-b86b-9f387a6bfa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9df18b03-ad06-4999-895c-ca29514ccee1', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca347069-c4cf-455c-bc73-c9bf0c5e06a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:41:57 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Volume volume-9df18b03-ad06-4999-895c-ca29514ccee1 (9df18b03-ad06-4999-895c-ca29514ccee1): created successfully Aug 05 10:41:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca347069-c4cf-455c-bc73-c9bf0c5e06a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:41:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Flow 'volume_create_manager' (abfa6cd7-ce15-4095-ae7b-f276ea29a014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:41:57 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-03cac90b-32c4-4797-8116-ede0cf13f1f8 tempest-CreateVolumesFromImageTest-999843810 None] Created volume successfully. Aug 05 10:41:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "cinder-9df18b03-ad06-4999-895c-ca29514ccee1-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:41:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-9df18b03-ad06-4999-895c-ca29514ccee1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:41:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "cinder-quobyte-9df18b03-ad06-4999-895c-ca29514ccee1" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:41:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-quobyte-9df18b03-ad06-4999-895c-ca29514ccee1" acquired by "delete_volume" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:41:57 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c02c75-44cb-4504-bc35-0fdcbc2e8573]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:41:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9df18b03-ad06-4999-895c-ca29514ccee1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:57 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9df18b03-ad06-4999-895c-ca29514ccee1 Aug 05 10:41:57 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:58 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9df18b03-ad06-4999-895c-ca29514ccee1" returned: 0 in 0.412s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9df18b03-ad06-4999-895c-ca29514ccee1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:58 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9df18b03-ad06-4999-895c-ca29514ccee1 Aug 05 10:41:58 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:58 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9df18b03-ad06-4999-895c-ca29514ccee1" returned: 0 in 0.290s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-quobyte-9df18b03-ad06-4999-895c-ca29514ccee1" released by "delete_volume" :: held 0.781s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] Created reservations ['7fa875aa-9adc-4450-a99c-1b954e9adcdc', 'ea308f71-eef4-40d0-a9dc-d9cb37d2e73c', 'c3f5799f-f16c-40ba-89cf-31cac7482b29', '47adb81a-09f0-41fe-8e68-8f0143662423'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:58 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:41:58 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "cinder-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:41:58 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.277s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:41:58 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] Deleted volume successfully. Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "cinder-quobyte-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-quobyte-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2" acquired by "delete_volume" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a0f74131-22ee-4eb9-bd83-72420890f83e tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-9df18b03-ad06-4999-895c-ca29514ccee1-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c74763f-3d4f-43a4-8e27-4948f93ccc83]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:41:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:58 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2 Aug 05 10:41:58 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:59 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2" returned: 0 in 0.417s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:59 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2 Aug 05 10:41:59 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:59 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Aug 05 10:41:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2" returned: 0 in 0.280s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:41:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-quobyte-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2" released by "delete_volume" :: held 0.754s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:41:59 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] Created reservations ['aebc2144-074d-4124-9fa7-182ac1f051bf', '50e620da-ed41-4588-88c6-1f5e3852e02b', '0788017a-6fcd-4f60-a6a2-3ca372cd60a0', '506918fe-27a9-4ea8-8b90-03e4e0a02486'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:41:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:41:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:41:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:41:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:41:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:41:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:41:59 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:41:59 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:41:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "cinder-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:41:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:41:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "cinder-quobyte-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:00 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-quobyte-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:00 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.315s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:00 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:00 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df98698-dee9-4b12-94c4-61a237fd2d83]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:00 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] Deleted volume successfully. Aug 05 10:42:00 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-018c28da-b706-4365-b228-a4f68b4f8353 tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-9a75f097-93fe-4faf-bbbf-3cc5f7f426e2-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:00 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e Aug 05 10:42:00 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:00 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e" returned: 0 in 0.418s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:00 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e Aug 05 10:42:00 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:00 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e" returned: 0 in 0.323s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:00 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-quobyte-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e" released by "delete_volume" :: held 0.806s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:00 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] Created reservations ['d8895060-df64-47be-b4f0-c8cb5ad24d1c', '6788dd2b-306c-4b2b-bc6a-dbd52a761e04', '5e246bae-f524-4459-85f5-c289e2a7bc3a', 'bc8d044d-204d-4f60-8482-71f8866914ac'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:01 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:01 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "cinder-038b78b0-d3bf-4fc8-b2cc-353ea1437d42-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-038b78b0-d3bf-4fc8-b2cc-353ea1437d42-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "cinder-quobyte-038b78b0-d3bf-4fc8-b2cc-353ea1437d42" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-quobyte-038b78b0-d3bf-4fc8-b2cc-353ea1437d42" acquired by "delete_volume" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:01 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4d37bb-200a-4a32-bf56-11b6868583e3]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-038b78b0-d3bf-4fc8-b2cc-353ea1437d42 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:01 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.479s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:01 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:01 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] Deleted volume successfully. Aug 05 10:42:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2ebe2d36-6294-4304-b609-10cef6637f64 tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-e98c1249-62a5-42fe-a2d7-1e4f6fb2383e-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:01 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-038b78b0-d3bf-4fc8-b2cc-353ea1437d42 Aug 05 10:42:01 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:01 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-038b78b0-d3bf-4fc8-b2cc-353ea1437d42" returned: 0 in 0.578s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-038b78b0-d3bf-4fc8-b2cc-353ea1437d42 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:01 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-038b78b0-d3bf-4fc8-b2cc-353ea1437d42 Aug 05 10:42:01 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:02 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-038b78b0-d3bf-4fc8-b2cc-353ea1437d42" returned: 0 in 0.300s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-quobyte-038b78b0-d3bf-4fc8-b2cc-353ea1437d42" released by "delete_volume" :: held 0.938s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:02 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] Created reservations ['5c010754-d3dc-4aa5-a9d3-6247931b519a', 'dcb80cee-d395-4c8a-946f-9d69aa98d248', '032f0eb7-2ef7-4a27-b7a8-65fd2e40f3c7', 'a6a09ca4-73a0-497a-b33c-a2cc47b847a7'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:02 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:02 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:02 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.321s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:02 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:02 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] Deleted volume successfully. Aug 05 10:42:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c7a79e04-4303-4d25-b3bd-da09b2219819 tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-038b78b0-d3bf-4fc8-b2cc-353ea1437d42-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "cinder-fa87989b-73fb-4e0e-942f-a3d329d0810d-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-fa87989b-73fb-4e0e-942f-a3d329d0810d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "cinder-quobyte-fa87989b-73fb-4e0e-942f-a3d329d0810d" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-quobyte-fa87989b-73fb-4e0e-942f-a3d329d0810d" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:03 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5c1310-e4e6-400d-9fcd-39d5b11dd334]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fa87989b-73fb-4e0e-942f-a3d329d0810d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:03 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fa87989b-73fb-4e0e-942f-a3d329d0810d Aug 05 10:42:03 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:04 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fa87989b-73fb-4e0e-942f-a3d329d0810d" returned: 0 in 0.437s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fa87989b-73fb-4e0e-942f-a3d329d0810d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:04 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fa87989b-73fb-4e0e-942f-a3d329d0810d Aug 05 10:42:04 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:04 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-fa87989b-73fb-4e0e-942f-a3d329d0810d" returned: 0 in 0.270s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-quobyte-fa87989b-73fb-4e0e-942f-a3d329d0810d" released by "delete_volume" :: held 0.765s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:04 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] Created reservations ['6da334c8-a249-4800-acae-687daa3eacc9', 'e7b52574-ff77-4200-82fe-c0782454917e', 'cabf1100-ea1c-425f-8984-451c82b20f30', '2399d0af-a2ad-4ade-aff9-71bcf7a0b5ab'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:04 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:04 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:04 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.266s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:04 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:04 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] Deleted volume successfully. Aug 05 10:42:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ea147d1d-42e2-4edd-8421-4eb8892c0e26 tempest-CreateVolumesFromImageTest-999843810 None] Lock "cinder-fa87989b-73fb-4e0e-942f-a3d329d0810d-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Flow 'volume_create_manager' (443777b8-3716-4598-873f-be0fdac674ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921c03fc-bac6-429c-99e3-40040f70cb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921c03fc-bac6-429c-99e3-40040f70cb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1511946542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc50673-16fb-4eab-96b3-7f69e0c9b535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feaced8e654800a8fb0710eb3030bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:08Z,use_quota=True,user_id='0d8093754135464cb0883d2ea1f74e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1136085-69cb-4e7e-8d10-d8ed6ac8cd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1136085-69cb-4e7e-8d10-d8ed6ac8cd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62020553-ae91-4af3-adc7-c16b189b5098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62020553-ae91-4af3-adc7-c16b189b5098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fc50673-16fb-4eab-96b3-7f69e0c9b535', 'volume_name': 'volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3967a124-8e0a-4e86-b764-f1ae671d22f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3967a124-8e0a-4e86-b764-f1ae671d22f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7566a76-435e-41fa-a89c-36b6ceee87ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:07 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume 5fc50673-16fb-4eab-96b3-7f69e0c9b535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535', 'volume_size': 1} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1511946542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc50673-16fb-4eab-96b3-7f69e0c9b535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feaced8e654800a8fb0710eb3030bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:08Z,use_quota=True,user_id='0d8093754135464cb0883d2ea1f74e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Creating volume 5fc50673-16fb-4eab-96b3-7f69e0c9b535 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:42:07 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:42:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:07 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535 1073741824 Aug 05 10:42:07 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:08 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535 1073741824" returned: 0 in 0.449s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:08 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535 Aug 05 10:42:08 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:08 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535" returned: 0 in 0.246s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:42:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7566a76-435e-41fa-a89c-36b6ceee87ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af96483a-2838-4ec1-b006-95f0bfe29994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:08 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535 (5fc50673-16fb-4eab-96b3-7f69e0c9b535): created successfully Aug 05 10:42:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af96483a-2838-4ec1-b006-95f0bfe29994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Flow 'volume_create_manager' (443777b8-3716-4598-873f-be0fdac674ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:08 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-78ad5182-ec81-4b39-acce-9a18f5ae3ae0 tempest-CreateVolumesFromSnapshotTest-725928967 None] Created volume successfully. Aug 05 10:42:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] Creating offline snapshot a89cff77-cb21-4df6-865a-d756ab3a7d78 of volume 5fc50673-16fb-4eab-96b3-7f69e0c9b535 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:42:08 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f765890e-ffb3-4ce5-8250-d6c743de6d08]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:09 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535 Aug 05 10:42:09 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:09 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535" returned: 0 in 0.376s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:09 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78 1G Aug 05 10:42:09 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:09 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78 1G" returned: 0 in 0.400s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:09 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78 Aug 05 10:42:09 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:10 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78" returned: 0 in 0.318s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:10 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78 is being set with open permissions: ugo+rw Aug 05 10:42:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:10 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78 Aug 05 10:42:10 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:10 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78" returned: 0 in 0.249s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:10 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.info Aug 05 10:42:10 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:10 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.info" returned: 0 in 0.245s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:10 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.info is being set with open permissions: ugo+rw Aug 05 10:42:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:10 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.info Aug 05 10:42:10 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:10 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.info" returned: 0 in 0.281s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:10 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-44a68f50-a510-4ff6-b4cc-f6808e5b16d5 tempest-CreateVolumesFromSnapshotTest-725928967 None] Create snapshot completed successfully Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Flow 'volume_create_manager' (d81341d8-07a1-49a9-8e88-4fd582dfcf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde82cd6-f24e-4653-9157-cce81d85d9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde82cd6-f24e-4653-9157-cce81d85d9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1524549145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980ad0cd-ac30-4403-a8e8-eb2997033196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feaced8e654800a8fb0710eb3030bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:11Z,use_quota=True,user_id='0d8093754135464cb0883d2ea1f74e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7603f889-2b41-4d56-b312-e71ad6c44924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7603f889-2b41-4d56-b312-e71ad6c44924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6fdde45-7a2b-4ea6-9007-86d6d6e1ed89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6fdde45-7a2b-4ea6-9007-86d6d6e1ed89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '980ad0cd-ac30-4403-a8e8-eb2997033196', 'volume_name': 'volume-980ad0cd-ac30-4403-a8e8-eb2997033196', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5610650-bc5d-4776-9e7f-336f77bbe652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5610650-bc5d-4776-9e7f-336f77bbe652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0a1af8-2686-426e-8392-1dfd3f4990a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:11 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume 980ad0cd-ac30-4403-a8e8-eb2997033196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-980ad0cd-ac30-4403-a8e8-eb2997033196', 'volume_size': 1} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1524549145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980ad0cd-ac30-4403-a8e8-eb2997033196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feaced8e654800a8fb0710eb3030bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:11Z,use_quota=True,user_id='0d8093754135464cb0883d2ea1f74e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Creating volume 980ad0cd-ac30-4403-a8e8-eb2997033196 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:42:11 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-980ad0cd-ac30-4403-a8e8-eb2997033196 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:11 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-980ad0cd-ac30-4403-a8e8-eb2997033196 1073741824 Aug 05 10:42:11 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:11 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Flow 'volume_create_manager' (e4402ccc-c93c-4f43-a527-642e5f15a697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08d9ff3-2972-4628-8190-7b1253ca175b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08d9ff3-2972-4628-8190-7b1253ca175b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-304235345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d54c470-2ee1-4d84-8213-baf2f0fd25f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feaced8e654800a8fb0710eb3030bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:12Z,use_quota=True,user_id='0d8093754135464cb0883d2ea1f74e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7956a22b-a814-4dea-8a3a-488e1b959a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7956a22b-a814-4dea-8a3a-488e1b959a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab35765-feec-482e-aa66-802a086b7b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab35765-feec-482e-aa66-802a086b7b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d54c470-2ee1-4d84-8213-baf2f0fd25f4', 'volume_name': 'volume-0d54c470-2ee1-4d84-8213-baf2f0fd25f4', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960f5f0d-3dcd-4201-a666-73f7435e73d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960f5f0d-3dcd-4201-a666-73f7435e73d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ccf56f1-4448-44e2-913a-c110a39387fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:12 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume 0d54c470-2ee1-4d84-8213-baf2f0fd25f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d54c470-2ee1-4d84-8213-baf2f0fd25f4', 'volume_size': 1} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:12 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-980ad0cd-ac30-4403-a8e8-eb2997033196 1073741824" returned: 0 in 0.663s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-980ad0cd-ac30-4403-a8e8-eb2997033196 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:12 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-980ad0cd-ac30-4403-a8e8-eb2997033196 Aug 05 10:42:12 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Flow 'volume_create_manager' (e68e4297-47e2-47d7-978d-276ca9d273d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84df3402-5cff-4b07-b9d4-e18fd3ae7022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84df3402-5cff-4b07-b9d4-e18fd3ae7022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-560588808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ebd60e-c761-4e3b-ac71-d3c4e996684f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feaced8e654800a8fb0710eb3030bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:12Z,use_quota=True,user_id='0d8093754135464cb0883d2ea1f74e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f31a52-b1ff-4509-8de2-c02279752d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f31a52-b1ff-4509-8de2-c02279752d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4efc95fc-ce77-4c75-9527-4cd87947fdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4efc95fc-ce77-4c75-9527-4cd87947fdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2ebd60e-c761-4e3b-ac71-d3c4e996684f', 'volume_name': 'volume-d2ebd60e-c761-4e3b-ac71-d3c4e996684f', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c07acf6-cf9c-41e1-84c9-0b6001635e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c07acf6-cf9c-41e1-84c9-0b6001635e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfcbc5d-f7c1-450c-95ee-34e6cef7fd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:12 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume d2ebd60e-c761-4e3b-ac71-d3c4e996684f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2ebd60e-c761-4e3b-ac71-d3c4e996684f', 'volume_size': 1} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:12 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-980ad0cd-ac30-4403-a8e8-eb2997033196" returned: 0 in 0.323s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.597s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-304235345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d54c470-2ee1-4d84-8213-baf2f0fd25f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feaced8e654800a8fb0710eb3030bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:12Z,use_quota=True,user_id='0d8093754135464cb0883d2ea1f74e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Creating volume 0d54c470-2ee1-4d84-8213-baf2f0fd25f4 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:42:12 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0d54c470-2ee1-4d84-8213-baf2f0fd25f4 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0a1af8-2686-426e-8392-1dfd3f4990a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-980ad0cd-ac30-4403-a8e8-eb2997033196', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:12 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0d54c470-2ee1-4d84-8213-baf2f0fd25f4 1073741824 Aug 05 10:42:12 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5d166c-d15d-47ea-8eda-61e065eabce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:12 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume volume-980ad0cd-ac30-4403-a8e8-eb2997033196 (980ad0cd-ac30-4403-a8e8-eb2997033196): created successfully Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5d166c-d15d-47ea-8eda-61e065eabce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Flow 'volume_create_manager' (d81341d8-07a1-49a9-8e88-4fd582dfcf2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:12 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c08cc284-3c3b-4f29-be1f-13e440598e3f tempest-CreateVolumesFromSnapshotTest-725928967 None] Created volume successfully. Aug 05 10:42:12 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Flow 'volume_create_manager' (6c4c4e39-620a-4e01-a3a3-6edecd1037df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21765206-b800-460a-8558-f8b3db5104aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21765206-b800-460a-8558-f8b3db5104aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-661808347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54a8b95-ba5e-4a83-8673-948577ef8529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feaced8e654800a8fb0710eb3030bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:13Z,use_quota=True,user_id='0d8093754135464cb0883d2ea1f74e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04344284-5519-40a1-97b7-0f9bf9ac1db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04344284-5519-40a1-97b7-0f9bf9ac1db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1186789-086a-43b4-afb0-dc13ac1888ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1186789-086a-43b4-afb0-dc13ac1888ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54a8b95-ba5e-4a83-8673-948577ef8529', 'volume_name': 'volume-b54a8b95-ba5e-4a83-8673-948577ef8529', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7b13cc-283b-440b-8a17-d47e5cd544db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7b13cc-283b-440b-8a17-d47e5cd544db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efa180b-6ce9-4f81-8e7a-bee82841736f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:13 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume b54a8b95-ba5e-4a83-8673-948577ef8529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54a8b95-ba5e-4a83-8673-948577ef8529', 'volume_size': 1} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:13 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0d54c470-2ee1-4d84-8213-baf2f0fd25f4 1073741824" returned: 0 in 0.598s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0d54c470-2ee1-4d84-8213-baf2f0fd25f4 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:13 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0d54c470-2ee1-4d84-8213-baf2f0fd25f4 Aug 05 10:42:13 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Flow 'volume_create_manager' (6c491b5e-221f-43fd-9d08-a3139a825858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af464c4-997a-4f01-b75d-034aefdd4d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af464c4-997a-4f01-b75d-034aefdd4d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1358146621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13faefcd-70f9-45c9-9466-38b3acd101d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feaced8e654800a8fb0710eb3030bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:13Z,use_quota=True,user_id='0d8093754135464cb0883d2ea1f74e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dabf069-00d2-48c5-81cc-06a1f4d678cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dabf069-00d2-48c5-81cc-06a1f4d678cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95242b67-b961-47e4-b2a9-ddd7fe158619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95242b67-b961-47e4-b2a9-ddd7fe158619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13faefcd-70f9-45c9-9466-38b3acd101d5', 'volume_name': 'volume-13faefcd-70f9-45c9-9466-38b3acd101d5', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497512d6-6b0e-4cfd-ae6b-45e775038920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497512d6-6b0e-4cfd-ae6b-45e775038920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4d771c-e737-4698-80cc-a0062c00480a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:13 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume 13faefcd-70f9-45c9-9466-38b3acd101d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13faefcd-70f9-45c9-9466-38b3acd101d5', 'volume_size': 1} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:13 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0d54c470-2ee1-4d84-8213-baf2f0fd25f4" returned: 0 in 0.262s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.078s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-560588808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ebd60e-c761-4e3b-ac71-d3c4e996684f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feaced8e654800a8fb0710eb3030bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:12Z,use_quota=True,user_id='0d8093754135464cb0883d2ea1f74e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Creating volume d2ebd60e-c761-4e3b-ac71-d3c4e996684f {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:42:13 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d2ebd60e-c761-4e3b-ac71-d3c4e996684f 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ccf56f1-4448-44e2-913a-c110a39387fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d54c470-2ee1-4d84-8213-baf2f0fd25f4', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:13 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d2ebd60e-c761-4e3b-ac71-d3c4e996684f 1073741824 Aug 05 10:42:13 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f132b30-3b25-4d32-8025-94412400f394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:13 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume volume-0d54c470-2ee1-4d84-8213-baf2f0fd25f4 (0d54c470-2ee1-4d84-8213-baf2f0fd25f4): created successfully Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f132b30-3b25-4d32-8025-94412400f394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Flow 'volume_create_manager' (e4402ccc-c93c-4f43-a527-642e5f15a697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:13 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8f80655b-3103-43a4-9113-d1b03fcea427 tempest-CreateVolumesFromSnapshotTest-725928967 None] Created volume successfully. Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:13 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:13 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:14 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d2ebd60e-c761-4e3b-ac71-d3c4e996684f 1073741824" returned: 0 in 0.538s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:14 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.300s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d2ebd60e-c761-4e3b-ac71-d3c4e996684f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:14 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d2ebd60e-c761-4e3b-ac71-d3c4e996684f Aug 05 10:42:14 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:14 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d2ebd60e-c761-4e3b-ac71-d3c4e996684f" returned: 0 in 0.268s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.397s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-661808347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54a8b95-ba5e-4a83-8673-948577ef8529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feaced8e654800a8fb0710eb3030bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:13Z,use_quota=True,user_id='0d8093754135464cb0883d2ea1f74e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Creating volume b54a8b95-ba5e-4a83-8673-948577ef8529 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:42:14 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b54a8b95-ba5e-4a83-8673-948577ef8529 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:14 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b54a8b95-ba5e-4a83-8673-948577ef8529 1073741824 Aug 05 10:42:14 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfcbc5d-f7c1-450c-95ee-34e6cef7fd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ebd60e-c761-4e3b-ac71-d3c4e996684f', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072aac15-5224-403c-bf3c-f5e35964ce9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:14 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume volume-d2ebd60e-c761-4e3b-ac71-d3c4e996684f (d2ebd60e-c761-4e3b-ac71-d3c4e996684f): created successfully Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072aac15-5224-403c-bf3c-f5e35964ce9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Flow 'volume_create_manager' (e68e4297-47e2-47d7-978d-276ca9d273d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:14 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8608987e-727b-483d-b7d3-a03d08a0713e tempest-CreateVolumesFromSnapshotTest-725928967 None] Created volume successfully. Aug 05 10:42:15 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b54a8b95-ba5e-4a83-8673-948577ef8529 1073741824" returned: 0 in 0.532s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b54a8b95-ba5e-4a83-8673-948577ef8529 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:15 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b54a8b95-ba5e-4a83-8673-948577ef8529 Aug 05 10:42:15 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:15 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b54a8b95-ba5e-4a83-8673-948577ef8529" returned: 0 in 0.256s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.854s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1358146621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13faefcd-70f9-45c9-9466-38b3acd101d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1feaced8e654800a8fb0710eb3030bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:13Z,use_quota=True,user_id='0d8093754135464cb0883d2ea1f74e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Creating volume 13faefcd-70f9-45c9-9466-38b3acd101d5 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:42:15 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-13faefcd-70f9-45c9-9466-38b3acd101d5 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efa180b-6ce9-4f81-8e7a-bee82841736f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54a8b95-ba5e-4a83-8673-948577ef8529', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:15 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-13faefcd-70f9-45c9-9466-38b3acd101d5 1073741824 Aug 05 10:42:15 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40cdf539-9eff-4e74-9732-ccdb9571edfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:15 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume volume-b54a8b95-ba5e-4a83-8673-948577ef8529 (b54a8b95-ba5e-4a83-8673-948577ef8529): created successfully Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40cdf539-9eff-4e74-9732-ccdb9571edfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Flow 'volume_create_manager' (6c4c4e39-620a-4e01-a3a3-6edecd1037df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:15 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-daca7293-ab37-4158-b5fa-77a0957d4bcb tempest-CreateVolumesFromSnapshotTest-725928967 None] Created volume successfully. Aug 05 10:42:15 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-13faefcd-70f9-45c9-9466-38b3acd101d5 1073741824" returned: 0 in 0.426s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-13faefcd-70f9-45c9-9466-38b3acd101d5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:15 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-13faefcd-70f9-45c9-9466-38b3acd101d5 Aug 05 10:42:15 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:16 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-13faefcd-70f9-45c9-9466-38b3acd101d5" returned: 0 in 0.243s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:16 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:42:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:16 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4d771c-e737-4698-80cc-a0062c00480a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13faefcd-70f9-45c9-9466-38b3acd101d5', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:16 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a92cf5-0445-44ac-beb5-b39f1e690a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:16 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Volume volume-13faefcd-70f9-45c9-9466-38b3acd101d5 (13faefcd-70f9-45c9-9466-38b3acd101d5): created successfully Aug 05 10:42:16 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a92cf5-0445-44ac-beb5-b39f1e690a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:16 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Flow 'volume_create_manager' (6c491b5e-221f-43fd-9d08-a3139a825858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:16 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-eea878bb-ccff-44fd-ad4d-e39fe6f19f48 tempest-CreateVolumesFromSnapshotTest-725928967 None] Created volume successfully. Aug 05 10:42:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "cinder-13faefcd-70f9-45c9-9466-38b3acd101d5-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-13faefcd-70f9-45c9-9466-38b3acd101d5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "cinder-quobyte-13faefcd-70f9-45c9-9466-38b3acd101d5" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-quobyte-13faefcd-70f9-45c9-9466-38b3acd101d5" acquired by "delete_volume" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:16 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[61397c15-63b6-47db-b6bc-5e728c67e1c7]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-13faefcd-70f9-45c9-9466-38b3acd101d5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:17 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-13faefcd-70f9-45c9-9466-38b3acd101d5 Aug 05 10:42:17 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:17 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-13faefcd-70f9-45c9-9466-38b3acd101d5" returned: 0 in 0.355s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-13faefcd-70f9-45c9-9466-38b3acd101d5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:17 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-13faefcd-70f9-45c9-9466-38b3acd101d5 Aug 05 10:42:17 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:17 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-13faefcd-70f9-45c9-9466-38b3acd101d5" returned: 0 in 0.239s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-quobyte-13faefcd-70f9-45c9-9466-38b3acd101d5" released by "delete_volume" :: held 0.632s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:17 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] Created reservations ['5d0af619-e683-4249-96d9-339795ae7ab6', '27b8898d-e05a-4351-9d30-129526f006b3', 'e7523ea3-3778-42dc-9622-32c915533e1b', '32576d5a-083b-4306-b0d1-84f63fdfb8a0'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:17 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:17 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:17 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.236s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:17 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:17 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] Deleted volume successfully. Aug 05 10:42:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0aba54d6-9688-4a24-972e-a063d59906c2 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-13faefcd-70f9-45c9-9466-38b3acd101d5-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "cinder-b54a8b95-ba5e-4a83-8673-948577ef8529-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-b54a8b95-ba5e-4a83-8673-948577ef8529-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "cinder-quobyte-b54a8b95-ba5e-4a83-8673-948577ef8529" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-quobyte-b54a8b95-ba5e-4a83-8673-948577ef8529" acquired by "delete_volume" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:18 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cdcda9-8cb5-4651-956d-43058ce39a4a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b54a8b95-ba5e-4a83-8673-948577ef8529 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:18 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b54a8b95-ba5e-4a83-8673-948577ef8529 Aug 05 10:42:18 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:18 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b54a8b95-ba5e-4a83-8673-948577ef8529" returned: 0 in 0.350s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b54a8b95-ba5e-4a83-8673-948577ef8529 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:18 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b54a8b95-ba5e-4a83-8673-948577ef8529 Aug 05 10:42:18 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:18 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b54a8b95-ba5e-4a83-8673-948577ef8529" returned: 0 in 0.238s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-quobyte-b54a8b95-ba5e-4a83-8673-948577ef8529" released by "delete_volume" :: held 0.626s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:18 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] Created reservations ['d26becd4-278b-49bf-839c-8007e14befcc', '0ed802ee-6002-41ca-b225-4777a6b22af4', '47c55da4-fba3-408a-92e1-5113751f1d12', '357e414d-e662-4a45-9252-a09a66c95e51'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:18 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:18 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:19 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.243s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:19 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:19 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] Deleted volume successfully. Aug 05 10:42:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4ed91d57-ac0f-46d4-939a-8ea7ccee662e tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-b54a8b95-ba5e-4a83-8673-948577ef8529-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "cinder-d2ebd60e-c761-4e3b-ac71-d3c4e996684f-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-d2ebd60e-c761-4e3b-ac71-d3c4e996684f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "cinder-quobyte-d2ebd60e-c761-4e3b-ac71-d3c4e996684f" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-quobyte-d2ebd60e-c761-4e3b-ac71-d3c4e996684f" acquired by "delete_volume" :: waited 0.014s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:19 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[003138af-2878-45f1-84a2-c4d94810ded4]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d2ebd60e-c761-4e3b-ac71-d3c4e996684f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:19 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d2ebd60e-c761-4e3b-ac71-d3c4e996684f Aug 05 10:42:19 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:19 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d2ebd60e-c761-4e3b-ac71-d3c4e996684f" returned: 0 in 0.353s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d2ebd60e-c761-4e3b-ac71-d3c4e996684f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:19 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d2ebd60e-c761-4e3b-ac71-d3c4e996684f Aug 05 10:42:19 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:19 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d2ebd60e-c761-4e3b-ac71-d3c4e996684f" returned: 0 in 0.248s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:19 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-quobyte-d2ebd60e-c761-4e3b-ac71-d3c4e996684f" released by "delete_volume" :: held 0.637s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:19 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] Created reservations ['5891706d-2c58-43dc-854c-4cda5463cf54', 'f8e3b130-944e-4609-b5aa-ef0a07f624bd', '9e4d3c48-98f2-418d-890a-7a14b0622441', '5d0b7595-177a-4ad7-865a-0a390bdfa8f4'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:20 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:20 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:20 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:20 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:20 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.248s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:20 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:20 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] Deleted volume successfully. Aug 05 10:42:20 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5c8d8d49-92c1-445d-bef3-248b3230dc6e tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-d2ebd60e-c761-4e3b-ac71-d3c4e996684f-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:20 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "cinder-0d54c470-2ee1-4d84-8213-baf2f0fd25f4-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:20 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-0d54c470-2ee1-4d84-8213-baf2f0fd25f4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:20 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "cinder-quobyte-0d54c470-2ee1-4d84-8213-baf2f0fd25f4" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:20 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-quobyte-0d54c470-2ee1-4d84-8213-baf2f0fd25f4" acquired by "delete_volume" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:20 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a89b1d-089b-47d2-8775-d0ae217f8b40]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0d54c470-2ee1-4d84-8213-baf2f0fd25f4 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:20 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0d54c470-2ee1-4d84-8213-baf2f0fd25f4 Aug 05 10:42:20 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:20 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0d54c470-2ee1-4d84-8213-baf2f0fd25f4" returned: 0 in 0.370s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0d54c470-2ee1-4d84-8213-baf2f0fd25f4 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:20 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0d54c470-2ee1-4d84-8213-baf2f0fd25f4 Aug 05 10:42:20 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:21 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-0d54c470-2ee1-4d84-8213-baf2f0fd25f4" returned: 0 in 0.253s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-quobyte-0d54c470-2ee1-4d84-8213-baf2f0fd25f4" released by "delete_volume" :: held 0.661s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] Created reservations ['30c35374-10b9-4b94-98c0-2c0a25a3814e', '10882c55-b8a8-4ea6-a1ef-d6b441ffb296', '137eb327-3ab9-4b20-845f-0298fa55d3dc', '46d418b3-637a-4591-b4c8-ecb85eec0398'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:21 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:21 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:21 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.247s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:21 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] Deleted volume successfully. Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1a8f584-b9a1-4728-8af4-f9afcf30ce51 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-0d54c470-2ee1-4d84-8213-baf2f0fd25f4-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "cinder-980ad0cd-ac30-4403-a8e8-eb2997033196-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-980ad0cd-ac30-4403-a8e8-eb2997033196-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "cinder-quobyte-980ad0cd-ac30-4403-a8e8-eb2997033196" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-quobyte-980ad0cd-ac30-4403-a8e8-eb2997033196" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab00eb4d-7cd7-4d1a-babf-d1bd225cd99f]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-980ad0cd-ac30-4403-a8e8-eb2997033196 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:21 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-980ad0cd-ac30-4403-a8e8-eb2997033196 Aug 05 10:42:21 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:22 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-980ad0cd-ac30-4403-a8e8-eb2997033196" returned: 0 in 0.372s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-980ad0cd-ac30-4403-a8e8-eb2997033196 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:22 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-980ad0cd-ac30-4403-a8e8-eb2997033196 Aug 05 10:42:22 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:22 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-980ad0cd-ac30-4403-a8e8-eb2997033196" returned: 0 in 0.258s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-quobyte-980ad0cd-ac30-4403-a8e8-eb2997033196" released by "delete_volume" :: held 0.672s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=115,cinder:UPDATE=126,cinder:INSERT=38,cinder:DELETE=19 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=109,cinder:UPDATE=147,cinder:INSERT=36,cinder:DELETE=5 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] Created reservations ['c5e2053c-fa94-4daf-b32a-53ea17cf97ea', '35f640e4-25c5-49ef-9100-15b0df7d43b6', 'e91357a6-5cf8-48ae-92b7-789fb218a332', '33ce547f-a81a-4dd5-8e0d-55b64dd61bb6'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:22 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:22 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:22 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.256s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:22 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] Deleted volume successfully. Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3244e981-276e-44bf-ae42-d198f04ebf68 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-980ad0cd-ac30-4403-a8e8-eb2997033196-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "cinder-a89cff77-cb21-4df6-865a-d756ab3a7d78-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-a89cff77-cb21-4df6-865a-d756ab3a7d78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "cinder-quobyte-5fc50673-16fb-4eab-96b3-7f69e0c9b535" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-quobyte-5fc50673-16fb-4eab-96b3-7f69e0c9b535" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "cinder-quobyte-a89cff77-cb21-4df6-865a-d756ab3a7d78" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-quobyte-a89cff77-cb21-4df6-865a-d756ab3a7d78" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] Deleting offline snapshot a89cff77-cb21-4df6-865a-d756ab3a7d78 of volume 5fc50673-16fb-4eab-96b3-7f69e0c9b535 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] snapshot_file for this snap is: volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ff1948-8a0f-4a4e-b83d-f2db01fc7941]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:22 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78 Aug 05 10:42:22 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:23 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78" returned: 0 in 0.398s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:42:23 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a53306-214b-49ff-aeff-6e6c54b81409]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:23 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535 Aug 05 10:42:23 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:23 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535" returned: 0 in 0.375s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:23 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78 Aug 05 10:42:23 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:24 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78" returned: 0 in 0.406s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:24 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78 Aug 05 10:42:24 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:24 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535.a89cff77-cb21-4df6-865a-d756ab3a7d78" returned: 0 in 0.253s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-quobyte-a89cff77-cb21-4df6-865a-d756ab3a7d78" released by "_delete_snapshot" :: held 1.540s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-quobyte-5fc50673-16fb-4eab-96b3-7f69e0c9b535" released by "delete_snapshot" :: held 1.571s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:24 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] Created reservations ['fe46e695-0de9-40de-824d-76b029e62557', '92da36e4-c8b2-4f5b-a8aa-3e497d92805c', '8656c098-6f6e-426a-8a21-fc5b5937bb4d', '7c5fc0a5-50f9-482d-8d7b-62520c2fe29c'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:24 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] Delete snapshot completed successfully. Aug 05 10:42:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9efb18d1-4626-4b62-b318-35c3d0da4fdb tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-a89cff77-cb21-4df6-865a-d756ab3a7d78-delete_snapshot" released by "delete_snapshot" :: held 1.718s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "cinder-5fc50673-16fb-4eab-96b3-7f69e0c9b535-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-5fc50673-16fb-4eab-96b3-7f69e0c9b535-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "cinder-quobyte-5fc50673-16fb-4eab-96b3-7f69e0c9b535" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-quobyte-5fc50673-16fb-4eab-96b3-7f69e0c9b535" acquired by "delete_volume" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:25 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1132d510-3254-454b-bbfb-308d1e4eff0e]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:25 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535 Aug 05 10:42:25 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:25 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535" returned: 0 in 0.378s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:25 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535 Aug 05 10:42:25 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:25 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5fc50673-16fb-4eab-96b3-7f69e0c9b535" returned: 0 in 0.258s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-quobyte-5fc50673-16fb-4eab-96b3-7f69e0c9b535" released by "delete_volume" :: held 0.714s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:25 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] Created reservations ['1a12e355-8179-402b-ad13-eb06fe4a5a43', '2cb4308a-891d-4c73-9a54-5505e6734aec', '801bf5ff-db07-4c7a-a0d2-8be424ad715a', '479116b5-f173-4daf-b52a-474b71191237'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:25 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:25 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:26 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.418s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:26 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:26 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] Deleted volume successfully. Aug 05 10:42:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9ac80fde-12b5-45a4-81d7-dd6732e8c491 tempest-CreateVolumesFromSnapshotTest-725928967 None] Lock "cinder-5fc50673-16fb-4eab-96b3-7f69e0c9b535-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:26 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-e1ef722b-dba5-4517-b5a7-b14621077ad4 req-960ab6a1-365f-48f3-89f3-fd73156a7578 tempest-TestShelveInstance-446779605 None] Terminate volume connection completed successfully. Aug 05 10:42:26 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-e1ef722b-dba5-4517-b5a7-b14621077ad4 req-960ab6a1-365f-48f3-89f3-fd73156a7578 tempest-TestShelveInstance-446779605 None] Deleting attachment c54c3c9a-a015-4501-a61c-8358e5a52714. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Flow 'volume_create_manager' (f4a04c17-e26c-4435-99f0-2d08508ed67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e7d4aa-60c4-48f3-b969-884b6d74f254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e7d4aa-60c4-48f3-b969-884b6d74f254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1321476050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8853c0-de30-49ab-8394-1a017a009956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f3962b33fa4745bb48f55cf8d54617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:29Z,use_quota=True,user_id='9f821a69829b4b9cb542bf362ad88aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d239bae6-1a8e-4c44-917b-70e25e2db226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d239bae6-1a8e-4c44-917b-70e25e2db226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bb0747-ca84-457a-af69-595a76b81fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bb0747-ca84-457a-af69-595a76b81fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f8853c0-de30-49ab-8394-1a017a009956', 'volume_name': 'volume-6f8853c0-de30-49ab-8394-1a017a009956', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb27e9b-fbea-4773-a939-f06d421edfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb27e9b-fbea-4773-a939-f06d421edfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40ee004-b435-43b5-bc12-88cd318f65fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:29 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume 6f8853c0-de30-49ab-8394-1a017a009956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f8853c0-de30-49ab-8394-1a017a009956', 'volume_size': 1} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1321476050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8853c0-de30-49ab-8394-1a017a009956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f3962b33fa4745bb48f55cf8d54617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:29Z,use_quota=True,user_id='9f821a69829b4b9cb542bf362ad88aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Creating volume 6f8853c0-de30-49ab-8394-1a017a009956 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:42:29 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f8853c0-de30-49ab-8394-1a017a009956 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:29 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f8853c0-de30-49ab-8394-1a017a009956 1073741824 Aug 05 10:42:29 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-77a6d2c4-fee4-4696-982d-8a2b270a99e3 req-39483a00-ce70-42ce-ba9f-c5f83e4d1f4d tempest-TestShelveInstance-446779605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:29 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f8853c0-de30-49ab-8394-1a017a009956 1073741824" returned: 0 in 0.462s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f8853c0-de30-49ab-8394-1a017a009956 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:29 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f8853c0-de30-49ab-8394-1a017a009956 Aug 05 10:42:29 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:30 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f8853c0-de30-49ab-8394-1a017a009956" returned: 0 in 0.244s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-77a6d2c4-fee4-4696-982d-8a2b270a99e3 req-39483a00-ce70-42ce-ba9f-c5f83e4d1f4d tempest-TestShelveInstance-446779605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.373s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40ee004-b435-43b5-bc12-88cd318f65fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f8853c0-de30-49ab-8394-1a017a009956', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4f2029-c1cf-44c0-9dac-edf0f80734d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-77a6d2c4-fee4-4696-982d-8a2b270a99e3 req-39483a00-ce70-42ce-ba9f-c5f83e4d1f4d tempest-TestShelveInstance-446779605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:30 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume volume-6f8853c0-de30-49ab-8394-1a017a009956 (6f8853c0-de30-49ab-8394-1a017a009956): created successfully Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4f2029-c1cf-44c0-9dac-edf0f80734d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Flow 'volume_create_manager' (f4a04c17-e26c-4435-99f0-2d08508ed67f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:30 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e9ca9992-b504-45a1-bff1-85051abdf352 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Created volume successfully. Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-77a6d2c4-fee4-4696-982d-8a2b270a99e3 req-39483a00-ce70-42ce-ba9f-c5f83e4d1f4d tempest-TestShelveInstance-446779605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7', 'name': 'volume-614407cd-88e1-4654-ad75-9387d3545c76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71158aac-d270-42fb-b67f-8e444d9f8a61', 'enforce_multipath': True} {{(pid=88736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 10:42:30 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-77a6d2c4-fee4-4696-982d-8a2b270a99e3 req-39483a00-ce70-42ce-ba9f-c5f83e4d1f4d tempest-TestShelveInstance-446779605 None] attachment_update completed successfully. Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Flow 'volume_create_manager' (8d12de39-813b-4b58-812b-ee35d6242de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d118d63-cd8b-4ddc-8454-31c6038e58d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d118d63-cd8b-4ddc-8454-31c6038e58d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-801779870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfe34dd-460c-4341-9265-b1298b879a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f3962b33fa4745bb48f55cf8d54617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:31Z,use_quota=True,user_id='9f821a69829b4b9cb542bf362ad88aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd44a80-cf3a-470d-abf7-76cdc73eb9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd44a80-cf3a-470d-abf7-76cdc73eb9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bca0216-c611-4be5-a231-24cf11405047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bca0216-c611-4be5-a231-24cf11405047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbfe34dd-460c-4341-9265-b1298b879a09', 'volume_name': 'volume-bbfe34dd-460c-4341-9265-b1298b879a09', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3312ebb1-d12c-42c6-9c24-1589efd94c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3312ebb1-d12c-42c6-9c24-1589efd94c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ab134d-8ab8-444e-9ee0-7d6e49a4ef70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:30 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume bbfe34dd-460c-4341-9265-b1298b879a09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbfe34dd-460c-4341-9265-b1298b879a09', 'volume_size': 1} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-801779870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfe34dd-460c-4341-9265-b1298b879a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f3962b33fa4745bb48f55cf8d54617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:31Z,use_quota=True,user_id='9f821a69829b4b9cb542bf362ad88aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Creating volume bbfe34dd-460c-4341-9265-b1298b879a09 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:42:30 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:42:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bbfe34dd-460c-4341-9265-b1298b879a09 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:30 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bbfe34dd-460c-4341-9265-b1298b879a09 1073741824 Aug 05 10:42:30 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Flow 'volume_create_manager' (c16442c5-fb2d-447e-a2d9-74d06abc4db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3cc76ee-cbf5-4221-90d9-9352eb81131f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3cc76ee-cbf5-4221-90d9-9352eb81131f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1710412376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915cbe19-b3a3-49d7-a337-34e40f1ab138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f3962b33fa4745bb48f55cf8d54617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:31Z,use_quota=True,user_id='9f821a69829b4b9cb542bf362ad88aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d1c9d5-16a9-4e03-bf74-b284086433b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d1c9d5-16a9-4e03-bf74-b284086433b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3d6a2e-8df7-45f6-bcbc-5cc5fbcd7ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3d6a2e-8df7-45f6-bcbc-5cc5fbcd7ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '915cbe19-b3a3-49d7-a337-34e40f1ab138', 'volume_name': 'volume-915cbe19-b3a3-49d7-a337-34e40f1ab138', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ba1ef6-eed3-491b-9b06-98a160477653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ba1ef6-eed3-491b-9b06-98a160477653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798bbce5-a98f-4ef9-9e4c-1a755e576119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:31 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume 915cbe19-b3a3-49d7-a337-34e40f1ab138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-915cbe19-b3a3-49d7-a337-34e40f1ab138', 'volume_size': 1} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:31 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bbfe34dd-460c-4341-9265-b1298b879a09 1073741824" returned: 0 in 0.606s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bbfe34dd-460c-4341-9265-b1298b879a09 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:31 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bbfe34dd-460c-4341-9265-b1298b879a09 Aug 05 10:42:31 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Flow 'volume_create_manager' (a7f14e1a-278b-4e88-9448-8348765c3e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db60b25d-a5de-4ad4-a3d0-c74b1e47fe9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db60b25d-a5de-4ad4-a3d0-c74b1e47fe9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-706180903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399d0eb0-be8a-4734-8eb5-b2c1ac15978a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f3962b33fa4745bb48f55cf8d54617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:32Z,use_quota=True,user_id='9f821a69829b4b9cb542bf362ad88aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b090c94d-1d9e-4d06-bc7f-dda7a42f6294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b090c94d-1d9e-4d06-bc7f-dda7a42f6294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f3ac9a-3459-46bc-9ff2-da0a57cf8f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f3ac9a-3459-46bc-9ff2-da0a57cf8f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '399d0eb0-be8a-4734-8eb5-b2c1ac15978a', 'volume_name': 'volume-399d0eb0-be8a-4734-8eb5-b2c1ac15978a', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7964c71-6433-4004-8843-484e946492e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7964c71-6433-4004-8843-484e946492e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976c2fe9-bd20-4732-9b42-f6fd2b6a1c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:31 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume 399d0eb0-be8a-4734-8eb5-b2c1ac15978a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-399d0eb0-be8a-4734-8eb5-b2c1ac15978a', 'volume_size': 1} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:31 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bbfe34dd-460c-4341-9265-b1298b879a09" returned: 0 in 0.352s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.492s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1710412376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915cbe19-b3a3-49d7-a337-34e40f1ab138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f3962b33fa4745bb48f55cf8d54617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:31Z,use_quota=True,user_id='9f821a69829b4b9cb542bf362ad88aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Creating volume 915cbe19-b3a3-49d7-a337-34e40f1ab138 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:42:31 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-915cbe19-b3a3-49d7-a337-34e40f1ab138 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ab134d-8ab8-444e-9ee0-7d6e49a4ef70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbfe34dd-460c-4341-9265-b1298b879a09', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:31 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-915cbe19-b3a3-49d7-a337-34e40f1ab138 1073741824 Aug 05 10:42:31 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:31 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5329ad7-c748-4a2f-b82f-59286ef0c038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:32 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume volume-bbfe34dd-460c-4341-9265-b1298b879a09 (bbfe34dd-460c-4341-9265-b1298b879a09): created successfully Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5329ad7-c748-4a2f-b82f-59286ef0c038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Flow 'volume_create_manager' (8d12de39-813b-4b58-812b-ee35d6242de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:32 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ab9a226b-5624-4aae-a9f1-bb67445d5665 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Created volume successfully. Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Flow 'volume_create_manager' (4a1d00fc-dc5e-4e4f-a4eb-7aa70f7352b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7138dd19-2e35-44b1-b52b-6764ca04e99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7138dd19-2e35-44b1-b52b-6764ca04e99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-390583038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0116b15-92e2-41a3-ac1a-465203ed2a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f3962b33fa4745bb48f55cf8d54617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:32Z,use_quota=True,user_id='9f821a69829b4b9cb542bf362ad88aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9908e57c-967f-4910-b685-294107a02873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9908e57c-967f-4910-b685-294107a02873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3402cc-ee85-44aa-a422-7f2374c9827f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3402cc-ee85-44aa-a422-7f2374c9827f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0116b15-92e2-41a3-ac1a-465203ed2a60', 'volume_name': 'volume-b0116b15-92e2-41a3-ac1a-465203ed2a60', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42b1f8b-7bc4-4a3f-ac23-ac5c15063b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42b1f8b-7bc4-4a3f-ac23-ac5c15063b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (210ba257-eef4-48e9-a687-26a5e8a6778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:32 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume b0116b15-92e2-41a3-ac1a-465203ed2a60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0116b15-92e2-41a3-ac1a-465203ed2a60', 'volume_size': 1} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:32 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-915cbe19-b3a3-49d7-a337-34e40f1ab138 1073741824" returned: 0 in 0.699s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-915cbe19-b3a3-49d7-a337-34e40f1ab138 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:32 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-915cbe19-b3a3-49d7-a337-34e40f1ab138 Aug 05 10:42:32 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Flow 'volume_create_manager' (22954b2e-90ff-4ac0-854b-98d6b37fe742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df283f9a-ec7f-432d-bea6-c99d8c5e6cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df283f9a-ec7f-432d-bea6-c99d8c5e6cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1699436492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f3962b33fa4745bb48f55cf8d54617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:33Z,use_quota=True,user_id='9f821a69829b4b9cb542bf362ad88aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de62545-da38-4ff3-b544-eac8af1d63e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de62545-da38-4ff3-b544-eac8af1d63e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc7f1db5-96df-4222-8a81-809c9bc8d4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc7f1db5-96df-4222-8a81-809c9bc8d4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63', 'volume_name': 'volume-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d08b23-537b-47aa-a05b-35141643cc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d08b23-537b-47aa-a05b-35141643cc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2fa298-2480-4e79-85d3-d6b102568754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:32 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume 66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63', 'volume_size': 1} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:32 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-915cbe19-b3a3-49d7-a337-34e40f1ab138" returned: 0 in 0.277s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.070s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-706180903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399d0eb0-be8a-4734-8eb5-b2c1ac15978a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f3962b33fa4745bb48f55cf8d54617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:32Z,use_quota=True,user_id='9f821a69829b4b9cb542bf362ad88aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Creating volume 399d0eb0-be8a-4734-8eb5-b2c1ac15978a {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:42:32 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:42:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-399d0eb0-be8a-4734-8eb5-b2c1ac15978a 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798bbce5-a98f-4ef9-9e4c-1a755e576119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-915cbe19-b3a3-49d7-a337-34e40f1ab138', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f73cdd3-963f-4a58-afd9-b7a3ba2c7ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:33 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-399d0eb0-be8a-4734-8eb5-b2c1ac15978a 1073741824 Aug 05 10:42:33 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:33 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume volume-915cbe19-b3a3-49d7-a337-34e40f1ab138 (915cbe19-b3a3-49d7-a337-34e40f1ab138): created successfully Aug 05 10:42:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f73cdd3-963f-4a58-afd9-b7a3ba2c7ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Flow 'volume_create_manager' (c16442c5-fb2d-447e-a2d9-74d06abc4db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:33 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-315bb3d1-b2bd-494e-9309-47d34915f588 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Created volume successfully. Aug 05 10:42:33 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-399d0eb0-be8a-4734-8eb5-b2c1ac15978a 1073741824" returned: 0 in 0.661s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-399d0eb0-be8a-4734-8eb5-b2c1ac15978a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:33 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-399d0eb0-be8a-4734-8eb5-b2c1ac15978a Aug 05 10:42:33 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:34 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-399d0eb0-be8a-4734-8eb5-b2c1ac15978a" returned: 0 in 0.373s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.634s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-390583038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0116b15-92e2-41a3-ac1a-465203ed2a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f3962b33fa4745bb48f55cf8d54617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:32Z,use_quota=True,user_id='9f821a69829b4b9cb542bf362ad88aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Creating volume b0116b15-92e2-41a3-ac1a-465203ed2a60 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:42:34 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b0116b15-92e2-41a3-ac1a-465203ed2a60 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:34 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b0116b15-92e2-41a3-ac1a-465203ed2a60 1073741824 Aug 05 10:42:34 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976c2fe9-bd20-4732-9b42-f6fd2b6a1c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-399d0eb0-be8a-4734-8eb5-b2c1ac15978a', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75d5764-5c80-4adc-bae6-ac2841122879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:34 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume volume-399d0eb0-be8a-4734-8eb5-b2c1ac15978a (399d0eb0-be8a-4734-8eb5-b2c1ac15978a): created successfully Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75d5764-5c80-4adc-bae6-ac2841122879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Flow 'volume_create_manager' (a7f14e1a-278b-4e88-9448-8348765c3e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:34 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d06c7ca6-13da-4ec7-a1b9-1aaafb65b3a4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Created volume successfully. Aug 05 10:42:34 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b0116b15-92e2-41a3-ac1a-465203ed2a60 1073741824" returned: 0 in 0.640s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b0116b15-92e2-41a3-ac1a-465203ed2a60 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:34 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b0116b15-92e2-41a3-ac1a-465203ed2a60 Aug 05 10:42:34 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:35 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b0116b15-92e2-41a3-ac1a-465203ed2a60" returned: 0 in 0.254s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.246s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1699436492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f3962b33fa4745bb48f55cf8d54617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:33Z,use_quota=True,user_id='9f821a69829b4b9cb542bf362ad88aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Creating volume 66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:42:35 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (210ba257-eef4-48e9-a687-26a5e8a6778b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0116b15-92e2-41a3-ac1a-465203ed2a60', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:35 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63 1073741824 Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6acd46-697f-434d-99e4-98e658f1c8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:35 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:35 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume volume-b0116b15-92e2-41a3-ac1a-465203ed2a60 (b0116b15-92e2-41a3-ac1a-465203ed2a60): created successfully Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6acd46-697f-434d-99e4-98e658f1c8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Flow 'volume_create_manager' (4a1d00fc-dc5e-4e4f-a4eb-7aa70f7352b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:35 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-2b792b88-b5f2-4d37-a72d-353da4220e08 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Created volume successfully. Aug 05 10:42:35 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63 1073741824" returned: 0 in 0.475s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:35 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63 Aug 05 10:42:35 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:35 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63" returned: 0 in 0.252s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2fa298-2480-4e79-85d3-d6b102568754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f335acb4-e2bc-4f94-90e7-ca462864f796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:35 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Volume volume-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63 (66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63): created successfully Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f335acb4-e2bc-4f94-90e7-ca462864f796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Flow 'volume_create_manager' (22954b2e-90ff-4ac0-854b-98d6b37fe742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:35 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b87727c8-0e03-4617-a9ed-f1d0f675a6b4 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Created volume successfully. Aug 05 10:42:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "cinder-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "cinder-quobyte-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-quobyte-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:36 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7f6cf8-1e6e-41da-8648-b6e48505b2e3]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:36 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63 Aug 05 10:42:36 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:36 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63" returned: 0 in 0.381s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:36 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63 Aug 05 10:42:36 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:37 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63" returned: 0 in 0.287s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-quobyte-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63" released by "delete_volume" :: held 0.714s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Created reservations ['e4591092-426a-4d81-8ddd-77cc33558db7', '0c11a7b3-9d35-48b3-94b8-3692d4e22eea', '72d25ba5-5cdd-4994-8966-3ea88d854efc', '47a9f1ca-8faa-4804-b4e8-b4a6ea19c129'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:37 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:37 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "cinder-b0116b15-92e2-41a3-ac1a-465203ed2a60-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:37 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.312s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-b0116b15-92e2-41a3-ac1a-465203ed2a60-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:37 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Deleted volume successfully. Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "cinder-quobyte-b0116b15-92e2-41a3-ac1a-465203ed2a60" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-06cbce2f-55d2-475c-8c78-87ac2ea7c43f tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-66c3c5d7-c7fa-4d93-92b7-2c1e5abe6e63-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-quobyte-b0116b15-92e2-41a3-ac1a-465203ed2a60" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[397854cb-3307-4504-890c-e11b9bd54831]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b0116b15-92e2-41a3-ac1a-465203ed2a60 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:37 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b0116b15-92e2-41a3-ac1a-465203ed2a60 Aug 05 10:42:37 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:38 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b0116b15-92e2-41a3-ac1a-465203ed2a60" returned: 0 in 0.386s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b0116b15-92e2-41a3-ac1a-465203ed2a60 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:38 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b0116b15-92e2-41a3-ac1a-465203ed2a60 Aug 05 10:42:38 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:38 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b0116b15-92e2-41a3-ac1a-465203ed2a60" returned: 0 in 0.275s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-quobyte-b0116b15-92e2-41a3-ac1a-465203ed2a60" released by "delete_volume" :: held 0.708s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Created reservations ['2ac5bd7d-976c-4a55-bd69-b01e5ac06f26', '452cf540-ad79-4f7f-9b99-c766ee73b1a4', '71edc9f3-7d8b-472d-bc6f-72f511600966', '7eb2100b-aa4b-459e-b03d-063601e09829'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:38 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:38 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:38 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.266s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "cinder-399d0eb0-be8a-4734-8eb5-b2c1ac15978a-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:38 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Deleted volume successfully. Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-399d0eb0-be8a-4734-8eb5-b2c1ac15978a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d57b4f71-fa62-4f96-b3b6-0e249b82bbc7 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-b0116b15-92e2-41a3-ac1a-465203ed2a60-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "cinder-quobyte-399d0eb0-be8a-4734-8eb5-b2c1ac15978a" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-quobyte-399d0eb0-be8a-4734-8eb5-b2c1ac15978a" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7250c423-f08d-4de5-9abd-5fdc2230a851]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-399d0eb0-be8a-4734-8eb5-b2c1ac15978a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:38 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-399d0eb0-be8a-4734-8eb5-b2c1ac15978a Aug 05 10:42:38 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:39 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-399d0eb0-be8a-4734-8eb5-b2c1ac15978a" returned: 0 in 0.419s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-399d0eb0-be8a-4734-8eb5-b2c1ac15978a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:39 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-399d0eb0-be8a-4734-8eb5-b2c1ac15978a Aug 05 10:42:39 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:39 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-399d0eb0-be8a-4734-8eb5-b2c1ac15978a" returned: 0 in 0.263s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-quobyte-399d0eb0-be8a-4734-8eb5-b2c1ac15978a" released by "delete_volume" :: held 0.726s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:39 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Created reservations ['d1f3eb3a-bd8b-4685-817e-25e43a7c96a1', 'e9d9013c-1f69-4c50-abc7-1dbec6aafc02', '6c033043-1825-4ff5-891a-4692826bb2f5', '5c1ae6de-286b-46eb-9d17-6f53b23e0fb8'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:39 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:39 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "cinder-915cbe19-b3a3-49d7-a337-34e40f1ab138-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:39 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.280s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:39 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-915cbe19-b3a3-49d7-a337-34e40f1ab138-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:39 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Deleted volume successfully. Aug 05 10:42:40 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6df68b6b-f2b9-4a65-bd68-02a4ca593ad2 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-399d0eb0-be8a-4734-8eb5-b2c1ac15978a-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:40 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "cinder-quobyte-915cbe19-b3a3-49d7-a337-34e40f1ab138" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:40 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-quobyte-915cbe19-b3a3-49d7-a337-34e40f1ab138" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:40 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed03095-4b64-4665-8e38-717b0a3ab980]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-915cbe19-b3a3-49d7-a337-34e40f1ab138 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:40 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-915cbe19-b3a3-49d7-a337-34e40f1ab138 Aug 05 10:42:40 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:40 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-915cbe19-b3a3-49d7-a337-34e40f1ab138" returned: 0 in 0.380s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-915cbe19-b3a3-49d7-a337-34e40f1ab138 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:40 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-915cbe19-b3a3-49d7-a337-34e40f1ab138 Aug 05 10:42:40 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:40 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-915cbe19-b3a3-49d7-a337-34e40f1ab138" returned: 0 in 0.249s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:40 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-quobyte-915cbe19-b3a3-49d7-a337-34e40f1ab138" released by "delete_volume" :: held 0.674s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:40 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Created reservations ['64f75266-1900-43a2-8548-96f7bdc64aa5', '7e5af4ab-1be6-47b1-9707-310816479656', '93bfefc6-8733-496c-b238-8591785394e0', 'ce52c72f-eccb-40d4-85dd-821eef9f5f4a'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:40 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:40 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:41 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.260s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:41 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:41 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Deleted volume successfully. Aug 05 10:42:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "cinder-bbfe34dd-460c-4341-9265-b1298b879a09-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-0dac42e9-524c-4b39-9aa8-50259ddd66a0 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-915cbe19-b3a3-49d7-a337-34e40f1ab138-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-bbfe34dd-460c-4341-9265-b1298b879a09-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "cinder-quobyte-bbfe34dd-460c-4341-9265-b1298b879a09" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-quobyte-bbfe34dd-460c-4341-9265-b1298b879a09" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:41 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5760909-9caa-4cb7-a3d4-f323d37d7d72]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bbfe34dd-460c-4341-9265-b1298b879a09 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:41 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bbfe34dd-460c-4341-9265-b1298b879a09 Aug 05 10:42:41 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:41 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bbfe34dd-460c-4341-9265-b1298b879a09" returned: 0 in 0.369s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bbfe34dd-460c-4341-9265-b1298b879a09 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:41 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bbfe34dd-460c-4341-9265-b1298b879a09 Aug 05 10:42:41 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:41 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bbfe34dd-460c-4341-9265-b1298b879a09" returned: 0 in 0.263s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-quobyte-bbfe34dd-460c-4341-9265-b1298b879a09" released by "delete_volume" :: held 0.671s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:41 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Created reservations ['f38d9165-b45c-4863-9c26-171f7bfff9af', '077fa1fb-5de7-4cbd-bc45-6d0726912fd1', 'ea4f7e33-ee81-4431-bfd4-861a53b16106', '90ff6dd8-a348-4dee-8404-85489dd12e55'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:42 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:42 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:42 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.261s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:42 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:42 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Deleted volume successfully. Aug 05 10:42:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-43cc6c13-7df3-4b07-95be-6c3916e2d7d6 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-bbfe34dd-460c-4341-9265-b1298b879a09-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "cinder-6f8853c0-de30-49ab-8394-1a017a009956-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-6f8853c0-de30-49ab-8394-1a017a009956-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "cinder-quobyte-6f8853c0-de30-49ab-8394-1a017a009956" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-quobyte-6f8853c0-de30-49ab-8394-1a017a009956" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:42 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[94262507-46e9-4dc7-a18a-23be9350f15e]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f8853c0-de30-49ab-8394-1a017a009956 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:42 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f8853c0-de30-49ab-8394-1a017a009956 Aug 05 10:42:42 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:42 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f8853c0-de30-49ab-8394-1a017a009956" returned: 0 in 0.379s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f8853c0-de30-49ab-8394-1a017a009956 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:42 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f8853c0-de30-49ab-8394-1a017a009956 Aug 05 10:42:42 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:43 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6f8853c0-de30-49ab-8394-1a017a009956" returned: 0 in 0.248s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:43 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-quobyte-6f8853c0-de30-49ab-8394-1a017a009956" released by "delete_volume" :: held 0.671s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:43 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Created reservations ['798a32a9-1797-4aea-8519-65f410001717', '0c77503e-6e96-45e5-9a2c-dd4aeb43cae8', 'b6835952-2a67-4bc1-9e5b-94f8cc54f01e', '65d5388b-961e-4620-87dc-74784b8b0fd1'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:43 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:43 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:43 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.257s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:43 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:43 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Deleted volume successfully. Aug 05 10:42:43 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-066d246b-2d54-417a-995e-8e19cd1215f5 tempest-CreateVolumesFromSourceVolumeTest-656824122 None] Lock "cinder-6f8853c0-de30-49ab-8394-1a017a009956-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:46 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Flow 'volume_create_manager' (c4aa90ae-94cf-425f-b6a8-8c77f989cec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4891bfa5-0c9b-4b87-9cd5-40c3463fea9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4891bfa5-0c9b-4b87-9cd5-40c3463fea9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1281526898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117b2e55-521f-4d87-84ce-20c841410609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffc3b7e0ac34213b682923ba2a5f349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:47Z,use_quota=True,user_id='3eba924df9e04164ae19758dd2dbb186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1388f812-bd91-416d-948d-3e49514528d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1388f812-bd91-416d-948d-3e49514528d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a362dd-6100-4e9e-adff-841f69013f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a362dd-6100-4e9e-adff-841f69013f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117b2e55-521f-4d87-84ce-20c841410609', 'volume_name': 'volume-117b2e55-521f-4d87-84ce-20c841410609', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21eae7a-fc02-4990-8249-75422976f79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21eae7a-fc02-4990-8249-75422976f79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f675624-2ad5-4ef8-a152-0434c705c58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:47 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Volume 117b2e55-521f-4d87-84ce-20c841410609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117b2e55-521f-4d87-84ce-20c841410609', 'volume_size': 1} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1281526898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117b2e55-521f-4d87-84ce-20c841410609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffc3b7e0ac34213b682923ba2a5f349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:47Z,use_quota=True,user_id='3eba924df9e04164ae19758dd2dbb186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Creating volume 117b2e55-521f-4d87-84ce-20c841410609 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:42:47 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-117b2e55-521f-4d87-84ce-20c841410609 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:47 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-117b2e55-521f-4d87-84ce-20c841410609 1073741824 Aug 05 10:42:47 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:47 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-117b2e55-521f-4d87-84ce-20c841410609 1073741824" returned: 0 in 0.450s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-117b2e55-521f-4d87-84ce-20c841410609 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:47 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-117b2e55-521f-4d87-84ce-20c841410609 Aug 05 10:42:47 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:47 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-117b2e55-521f-4d87-84ce-20c841410609" returned: 0 in 0.280s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f675624-2ad5-4ef8-a152-0434c705c58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117b2e55-521f-4d87-84ce-20c841410609', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8815d164-0fe2-4709-9d4d-f741cd93c710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:47 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Volume volume-117b2e55-521f-4d87-84ce-20c841410609 (117b2e55-521f-4d87-84ce-20c841410609): created successfully Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8815d164-0fe2-4709-9d4d-f741cd93c710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Flow 'volume_create_manager' (c4aa90ae-94cf-425f-b6a8-8c77f989cec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:47 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-3e84e1f5-814e-4ac7-9f7c-74d6b8eb3cf3 tempest-ProjectReaderTests-178129396 None] Created volume successfully. Aug 05 10:42:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] Acquiring lock "cinder-117b2e55-521f-4d87-84ce-20c841410609-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] Lock "cinder-117b2e55-521f-4d87-84ce-20c841410609-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] Acquiring lock "cinder-quobyte-117b2e55-521f-4d87-84ce-20c841410609" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] Lock "cinder-quobyte-117b2e55-521f-4d87-84ce-20c841410609" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:48 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[efce0caa-38ff-4550-9f4f-4c60e9261cf8]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-117b2e55-521f-4d87-84ce-20c841410609 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:48 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-117b2e55-521f-4d87-84ce-20c841410609 Aug 05 10:42:48 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:48 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-117b2e55-521f-4d87-84ce-20c841410609" returned: 0 in 0.363s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-117b2e55-521f-4d87-84ce-20c841410609 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:48 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-117b2e55-521f-4d87-84ce-20c841410609 Aug 05 10:42:48 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:48 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-117b2e55-521f-4d87-84ce-20c841410609" returned: 0 in 0.261s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] Lock "cinder-quobyte-117b2e55-521f-4d87-84ce-20c841410609" released by "delete_volume" :: held 0.665s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:48 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] Created reservations ['b02a0030-5fa3-4541-a30b-11a131e2d530', '5383e73a-8b46-4e33-9de6-c0adc1fdcda2', '44edfaa0-fb5e-4b28-9380-f3e08a1fa253', '1c332a3f-c4b1-441e-be91-8a7cfbcaad97'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:49 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:49 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:49 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.277s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:49 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] Deleted volume successfully. Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-020245ca-a560-40f6-bf32-17c4ff934d23 tempest-ProjectReaderTests-178129396 None] Lock "cinder-117b2e55-521f-4d87-84ce-20c841410609-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Flow 'volume_create_manager' (eca17410-c4c5-4699-a188-57a14f5e3b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369ba3d4-31a2-4cf6-87f0-db3808735622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369ba3d4-31a2-4cf6-87f0-db3808735622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-919520865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37926c3-06ce-42d6-b3b0-2a559da5bf11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffc3b7e0ac34213b682923ba2a5f349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:50Z,use_quota=True,user_id='3eba924df9e04164ae19758dd2dbb186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c64d28-3b87-4235-9193-8e665ef1c8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c64d28-3b87-4235-9193-8e665ef1c8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8250be2c-403d-4c2d-95ba-01e2848014ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8250be2c-403d-4c2d-95ba-01e2848014ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a37926c3-06ce-42d6-b3b0-2a559da5bf11', 'volume_name': 'volume-a37926c3-06ce-42d6-b3b0-2a559da5bf11', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d5f079-ff2b-4438-a715-09a2c2d21293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d5f079-ff2b-4438-a715-09a2c2d21293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d9cd08-5986-43e3-a6c9-490843012acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:49 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Volume a37926c3-06ce-42d6-b3b0-2a559da5bf11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a37926c3-06ce-42d6-b3b0-2a559da5bf11', 'volume_size': 1} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-919520865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37926c3-06ce-42d6-b3b0-2a559da5bf11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffc3b7e0ac34213b682923ba2a5f349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:50Z,use_quota=True,user_id='3eba924df9e04164ae19758dd2dbb186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Creating volume a37926c3-06ce-42d6-b3b0-2a559da5bf11 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:42:49 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:42:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a37926c3-06ce-42d6-b3b0-2a559da5bf11 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:49 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a37926c3-06ce-42d6-b3b0-2a559da5bf11 1073741824 Aug 05 10:42:49 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:50 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a37926c3-06ce-42d6-b3b0-2a559da5bf11 1073741824" returned: 0 in 0.450s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a37926c3-06ce-42d6-b3b0-2a559da5bf11 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:50 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a37926c3-06ce-42d6-b3b0-2a559da5bf11 Aug 05 10:42:50 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:50 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a37926c3-06ce-42d6-b3b0-2a559da5bf11" returned: 0 in 0.246s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:42:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d9cd08-5986-43e3-a6c9-490843012acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a37926c3-06ce-42d6-b3b0-2a559da5bf11', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de1a55e-6d8b-488d-a4c5-8ffff7c6d61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:50 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Volume volume-a37926c3-06ce-42d6-b3b0-2a559da5bf11 (a37926c3-06ce-42d6-b3b0-2a559da5bf11): created successfully Aug 05 10:42:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de1a55e-6d8b-488d-a4c5-8ffff7c6d61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Flow 'volume_create_manager' (eca17410-c4c5-4699-a188-57a14f5e3b2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:50 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-0f837ef2-14d8-42bc-93ea-62a4c3f7ba88 tempest-ProjectReaderTests-178129396 None] Created volume successfully. Aug 05 10:42:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] Acquiring lock "cinder-a37926c3-06ce-42d6-b3b0-2a559da5bf11-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] Lock "cinder-a37926c3-06ce-42d6-b3b0-2a559da5bf11-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] Acquiring lock "cinder-quobyte-a37926c3-06ce-42d6-b3b0-2a559da5bf11" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] Lock "cinder-quobyte-a37926c3-06ce-42d6-b3b0-2a559da5bf11" acquired by "delete_volume" :: waited 0.014s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:50 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38f1692-d521-4dcd-82c6-93a2b321eeb1]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a37926c3-06ce-42d6-b3b0-2a559da5bf11 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:51 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a37926c3-06ce-42d6-b3b0-2a559da5bf11 Aug 05 10:42:51 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:51 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a37926c3-06ce-42d6-b3b0-2a559da5bf11" returned: 0 in 0.351s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a37926c3-06ce-42d6-b3b0-2a559da5bf11 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:51 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a37926c3-06ce-42d6-b3b0-2a559da5bf11 Aug 05 10:42:51 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:51 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a37926c3-06ce-42d6-b3b0-2a559da5bf11" returned: 0 in 0.240s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] Lock "cinder-quobyte-a37926c3-06ce-42d6-b3b0-2a559da5bf11" released by "delete_volume" :: held 0.629s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:51 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] Created reservations ['0eb2a408-9cd4-41a9-9cdb-a7d5760588af', '7cc4a888-9c54-45e1-98a1-663e1fabbaf3', '5990ea8b-8caa-474f-adea-44898352a730', '8a8d4ffd-6edc-4298-b9bc-cf7332a7be2e'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:51 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:51 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:51 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.242s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:51 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:51 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] Deleted volume successfully. Aug 05 10:42:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f8cd91f2-f105-488c-8159-eb3b71c067a0 tempest-ProjectReaderTests-178129396 None] Lock "cinder-a37926c3-06ce-42d6-b3b0-2a559da5bf11-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Flow 'volume_create_manager' (754834e3-a6f0-4792-a0ef-19bcac29c82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e5c07b-8feb-4a0c-8040-769d11a27bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e5c07b-8feb-4a0c-8040-769d11a27bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2084900280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14b03db-012b-4f50-8e22-17d28872cd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54adde4fe52e4d40ba934580cd69624c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:55Z,use_quota=True,user_id='6124a40f8d624106af3c7c4a811e3ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ddff39-5759-487b-8de0-bddef77d756c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ddff39-5759-487b-8de0-bddef77d756c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3321bf99-7af9-4ee1-8239-33197c1f7bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3321bf99-7af9-4ee1-8239-33197c1f7bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b14b03db-012b-4f50-8e22-17d28872cd08', 'volume_name': 'volume-b14b03db-012b-4f50-8e22-17d28872cd08', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c528ba0-bf3a-49a7-bfc6-c22ca8a7cea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c528ba0-bf3a-49a7-bfc6-c22ca8a7cea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c313eac9-c0e8-4e18-a0d7-b98697d41de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:55 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Volume b14b03db-012b-4f50-8e22-17d28872cd08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b14b03db-012b-4f50-8e22-17d28872cd08', 'volume_size': 1} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2084900280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14b03db-012b-4f50-8e22-17d28872cd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54adde4fe52e4d40ba934580cd69624c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:55Z,use_quota=True,user_id='6124a40f8d624106af3c7c4a811e3ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Creating volume b14b03db-012b-4f50-8e22-17d28872cd08 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:42:55 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:42:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b14b03db-012b-4f50-8e22-17d28872cd08 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:55 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b14b03db-012b-4f50-8e22-17d28872cd08 1073741824 Aug 05 10:42:55 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:56 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b14b03db-012b-4f50-8e22-17d28872cd08 1073741824" returned: 0 in 0.427s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b14b03db-012b-4f50-8e22-17d28872cd08 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:56 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b14b03db-012b-4f50-8e22-17d28872cd08 Aug 05 10:42:56 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:56 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b14b03db-012b-4f50-8e22-17d28872cd08" returned: 0 in 0.242s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:42:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c313eac9-c0e8-4e18-a0d7-b98697d41de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b14b03db-012b-4f50-8e22-17d28872cd08', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b15832a-4071-44fc-b423-f23aa48616e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:56 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Volume volume-b14b03db-012b-4f50-8e22-17d28872cd08 (b14b03db-012b-4f50-8e22-17d28872cd08): created successfully Aug 05 10:42:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b15832a-4071-44fc-b423-f23aa48616e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Flow 'volume_create_manager' (754834e3-a6f0-4792-a0ef-19bcac29c82c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:56 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-6230cef5-a962-4bb0-9040-9da97bca58e1 tempest-ProjectReaderTests-188570171 None] Created volume successfully. Aug 05 10:42:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] Acquiring lock "cinder-b14b03db-012b-4f50-8e22-17d28872cd08-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] Lock "cinder-b14b03db-012b-4f50-8e22-17d28872cd08-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] Acquiring lock "cinder-quobyte-b14b03db-012b-4f50-8e22-17d28872cd08" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] Lock "cinder-quobyte-b14b03db-012b-4f50-8e22-17d28872cd08" acquired by "delete_volume" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:56 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7fe86a-1aea-4470-b2f3-a462aa9fce4d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b14b03db-012b-4f50-8e22-17d28872cd08 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:56 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b14b03db-012b-4f50-8e22-17d28872cd08 Aug 05 10:42:56 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:57 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b14b03db-012b-4f50-8e22-17d28872cd08" returned: 0 in 0.395s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b14b03db-012b-4f50-8e22-17d28872cd08 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:57 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b14b03db-012b-4f50-8e22-17d28872cd08 Aug 05 10:42:57 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:57 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b14b03db-012b-4f50-8e22-17d28872cd08" returned: 0 in 0.260s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] Lock "cinder-quobyte-b14b03db-012b-4f50-8e22-17d28872cd08" released by "delete_volume" :: held 0.699s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:57 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] Created reservations ['8e747535-3e40-4fe2-8bbb-6468aff0968f', 'eead993f-a171-40a0-a84c-acda223679b8', '53e6546c-8ef7-4556-8285-dbb55dd15108', 'a54755d2-069a-4e30-83ca-ad20b08526d1'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:42:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:57 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:42:57 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:57 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.283s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:57 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:42:57 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] Deleted volume successfully. Aug 05 10:42:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d01f08cc-c465-4527-9244-a6034e90435c tempest-ProjectReaderTests-188570171 None] Lock "cinder-b14b03db-012b-4f50-8e22-17d28872cd08-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Flow 'volume_create_manager' (924dc5ee-7b46-40a2-9032-71c1c00a1a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15d8968-6c4e-4cc8-b5ec-0366d4dbeca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15d8968-6c4e-4cc8-b5ec-0366d4dbeca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503593640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1825a737-e01c-4235-9f8d-80dc47c8d8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54adde4fe52e4d40ba934580cd69624c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:58Z,use_quota=True,user_id='6124a40f8d624106af3c7c4a811e3ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24373a17-d1a3-466c-a57e-e6480cf6347a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24373a17-d1a3-466c-a57e-e6480cf6347a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779550a0-851e-4a96-84d2-128669875cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779550a0-851e-4a96-84d2-128669875cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1825a737-e01c-4235-9f8d-80dc47c8d8bc', 'volume_name': 'volume-1825a737-e01c-4235-9f8d-80dc47c8d8bc', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f7f655-10e0-430c-9e12-e2463d9aa5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f7f655-10e0-430c-9e12-e2463d9aa5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3fdd7ea-4bff-481a-83bb-bb32d77ebfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:58 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Volume 1825a737-e01c-4235-9f8d-80dc47c8d8bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1825a737-e01c-4235-9f8d-80dc47c8d8bc', 'volume_size': 1} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503593640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1825a737-e01c-4235-9f8d-80dc47c8d8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54adde4fe52e4d40ba934580cd69624c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:42:58Z,use_quota=True,user_id='6124a40f8d624106af3c7c4a811e3ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Creating volume 1825a737-e01c-4235-9f8d-80dc47c8d8bc {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:42:58 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1825a737-e01c-4235-9f8d-80dc47c8d8bc 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:58 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1825a737-e01c-4235-9f8d-80dc47c8d8bc 1073741824 Aug 05 10:42:58 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:58 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1825a737-e01c-4235-9f8d-80dc47c8d8bc 1073741824" returned: 0 in 0.426s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1825a737-e01c-4235-9f8d-80dc47c8d8bc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:58 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1825a737-e01c-4235-9f8d-80dc47c8d8bc Aug 05 10:42:58 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:59 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1825a737-e01c-4235-9f8d-80dc47c8d8bc" returned: 0 in 0.244s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:42:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:42:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3fdd7ea-4bff-481a-83bb-bb32d77ebfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1825a737-e01c-4235-9f8d-80dc47c8d8bc', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c32b835-43dc-4db9-b351-1c298a738431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:42:59 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Volume volume-1825a737-e01c-4235-9f8d-80dc47c8d8bc (1825a737-e01c-4235-9f8d-80dc47c8d8bc): created successfully Aug 05 10:42:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c32b835-43dc-4db9-b351-1c298a738431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:42:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Flow 'volume_create_manager' (924dc5ee-7b46-40a2-9032-71c1c00a1a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:42:59 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-44f8efbf-6fd9-49c5-ab1c-5a363151392f tempest-ProjectReaderTests-188570171 None] Created volume successfully. Aug 05 10:42:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] Acquiring lock "cinder-1825a737-e01c-4235-9f8d-80dc47c8d8bc-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] Lock "cinder-1825a737-e01c-4235-9f8d-80dc47c8d8bc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] Acquiring lock "cinder-quobyte-1825a737-e01c-4235-9f8d-80dc47c8d8bc" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:42:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] Lock "cinder-quobyte-1825a737-e01c-4235-9f8d-80dc47c8d8bc" acquired by "delete_volume" :: waited 0.014s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:42:59 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc18d67-246d-4636-82be-4c95fb3283a7]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:42:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1825a737-e01c-4235-9f8d-80dc47c8d8bc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:59 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1825a737-e01c-4235-9f8d-80dc47c8d8bc Aug 05 10:42:59 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:42:59 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Aug 05 10:42:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1825a737-e01c-4235-9f8d-80dc47c8d8bc" returned: 0 in 0.343s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:42:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1825a737-e01c-4235-9f8d-80dc47c8d8bc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:42:59 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1825a737-e01c-4235-9f8d-80dc47c8d8bc Aug 05 10:42:59 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:00 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-1825a737-e01c-4235-9f8d-80dc47c8d8bc" returned: 0 in 0.249s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] Lock "cinder-quobyte-1825a737-e01c-4235-9f8d-80dc47c8d8bc" released by "delete_volume" :: held 0.628s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] Created reservations ['c378a8a2-ce2b-47f1-972f-0ff428dd64d2', 'e0e4b20b-abee-46ac-800f-eb9c2f8c39ec', '2385206e-4ff1-4253-ab3b-8bad2652f036', '92239f40-696f-44e1-99db-6e67b949f500'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:00 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:43:00 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:00 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.250s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:43:00 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] Deleted volume successfully. Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e5af6689-1493-40d9-b742-8313b4276472 tempest-ProjectReaderTests-188570171 None] Lock "cinder-1825a737-e01c-4235-9f8d-80dc47c8d8bc-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Flow 'volume_create_manager' (05143765-9b80-4e2b-80e7-31a6c4c7467d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf49d19-7f44-475f-b688-1d4ee8178e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf49d19-7f44-475f-b688-1d4ee8178e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667136396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7072b8-65a6-4a3b-8a49-44648d11df42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54adde4fe52e4d40ba934580cd69624c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:43:01Z,use_quota=True,user_id='6124a40f8d624106af3c7c4a811e3ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08524c37-26e2-4f9f-a6c4-c40e855889d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08524c37-26e2-4f9f-a6c4-c40e855889d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376aee18-18f3-46dc-91f7-347cad5ba40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376aee18-18f3-46dc-91f7-347cad5ba40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af7072b8-65a6-4a3b-8a49-44648d11df42', 'volume_name': 'volume-af7072b8-65a6-4a3b-8a49-44648d11df42', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7db2fa-f06f-4a1b-9a63-b586f7a44148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7db2fa-f06f-4a1b-9a63-b586f7a44148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f253d7-7a6e-4c6d-b63b-d5cbf4d24f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:01 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Volume af7072b8-65a6-4a3b-8a49-44648d11df42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af7072b8-65a6-4a3b-8a49-44648d11df42', 'volume_size': 1} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667136396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7072b8-65a6-4a3b-8a49-44648d11df42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54adde4fe52e4d40ba934580cd69624c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:43:01Z,use_quota=True,user_id='6124a40f8d624106af3c7c4a811e3ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Creating volume af7072b8-65a6-4a3b-8a49-44648d11df42 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:43:01 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-af7072b8-65a6-4a3b-8a49-44648d11df42 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:01 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-af7072b8-65a6-4a3b-8a49-44648d11df42 1073741824 Aug 05 10:43:01 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:01 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-af7072b8-65a6-4a3b-8a49-44648d11df42 1073741824" returned: 0 in 0.414s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-af7072b8-65a6-4a3b-8a49-44648d11df42 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:01 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-af7072b8-65a6-4a3b-8a49-44648d11df42 Aug 05 10:43:01 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:01 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-af7072b8-65a6-4a3b-8a49-44648d11df42" returned: 0 in 0.244s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f253d7-7a6e-4c6d-b63b-d5cbf4d24f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af7072b8-65a6-4a3b-8a49-44648d11df42', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbade90a-68cb-40ce-b91b-f6cfe35ca6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:01 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Volume volume-af7072b8-65a6-4a3b-8a49-44648d11df42 (af7072b8-65a6-4a3b-8a49-44648d11df42): created successfully Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbade90a-68cb-40ce-b91b-f6cfe35ca6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Flow 'volume_create_manager' (05143765-9b80-4e2b-80e7-31a6c4c7467d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:43:01 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a4e5534c-c7de-4814-ab14-bc02cda56c61 tempest-ProjectReaderTests-188570171 None] Created volume successfully. Aug 05 10:43:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] Acquiring lock "cinder-af7072b8-65a6-4a3b-8a49-44648d11df42-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:43:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] Lock "cinder-af7072b8-65a6-4a3b-8a49-44648d11df42-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:43:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] Acquiring lock "cinder-quobyte-af7072b8-65a6-4a3b-8a49-44648d11df42" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:43:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] Lock "cinder-quobyte-af7072b8-65a6-4a3b-8a49-44648d11df42" acquired by "delete_volume" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:43:02 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[90994b0d-34be-42c3-bcba-c06dae229f08]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:43:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-af7072b8-65a6-4a3b-8a49-44648d11df42 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:02 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-af7072b8-65a6-4a3b-8a49-44648d11df42 Aug 05 10:43:02 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:02 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-af7072b8-65a6-4a3b-8a49-44648d11df42" returned: 0 in 0.352s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-af7072b8-65a6-4a3b-8a49-44648d11df42 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:02 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-af7072b8-65a6-4a3b-8a49-44648d11df42 Aug 05 10:43:02 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:02 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-af7072b8-65a6-4a3b-8a49-44648d11df42" returned: 0 in 0.240s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] Lock "cinder-quobyte-af7072b8-65a6-4a3b-8a49-44648d11df42" released by "delete_volume" :: held 0.631s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:43:02 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] Created reservations ['b96daae3-8345-4a0a-8e6d-370115755b19', '3d1ab92e-74eb-4045-b2f9-b840f51143b5', 'c07289d4-b9c3-4fd0-bf81-1f4defe629e5', '403a1fdf-5fbe-4316-9bff-73f38ec13204'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:43:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:43:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:43:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:43:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:43:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:43:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:02 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:43:02 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:03 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.249s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:43:03 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] Deleted volume successfully. Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5bea95f8-f5f0-4dcf-81d9-a4dd8b8d6f17 tempest-ProjectReaderTests-188570171 None] Lock "cinder-af7072b8-65a6-4a3b-8a49-44648d11df42-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Flow 'volume_create_manager' (2f9276b6-2569-4c38-8dc8-1e283a516ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75a34ab-68a4-4b19-a89f-9a3728a1bcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75a34ab-68a4-4b19-a89f-9a3728a1bcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-944859804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c5b5ad-7018-4aa3-808a-6119fd912f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54adde4fe52e4d40ba934580cd69624c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:43:04Z,use_quota=True,user_id='6124a40f8d624106af3c7c4a811e3ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4970429c-7f60-469a-8dce-2345e87cbe58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4970429c-7f60-469a-8dce-2345e87cbe58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff004e70-cb99-4ec7-8db1-76e89ce6d552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff004e70-cb99-4ec7-8db1-76e89ce6d552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4c5b5ad-7018-4aa3-808a-6119fd912f84', 'volume_name': 'volume-a4c5b5ad-7018-4aa3-808a-6119fd912f84', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0fa893-10d9-4d65-b646-e9544f0e399c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0fa893-10d9-4d65-b646-e9544f0e399c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d19a6b-9eec-407b-952e-46a47ef4a1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:03 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Volume a4c5b5ad-7018-4aa3-808a-6119fd912f84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4c5b5ad-7018-4aa3-808a-6119fd912f84', 'volume_size': 1} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-944859804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c5b5ad-7018-4aa3-808a-6119fd912f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54adde4fe52e4d40ba934580cd69624c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:43:04Z,use_quota=True,user_id='6124a40f8d624106af3c7c4a811e3ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Creating volume a4c5b5ad-7018-4aa3-808a-6119fd912f84 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:43:03 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:43:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a4c5b5ad-7018-4aa3-808a-6119fd912f84 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:03 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a4c5b5ad-7018-4aa3-808a-6119fd912f84 1073741824 Aug 05 10:43:03 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:04 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a4c5b5ad-7018-4aa3-808a-6119fd912f84 1073741824" returned: 0 in 0.427s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a4c5b5ad-7018-4aa3-808a-6119fd912f84 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:04 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a4c5b5ad-7018-4aa3-808a-6119fd912f84 Aug 05 10:43:04 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:04 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a4c5b5ad-7018-4aa3-808a-6119fd912f84" returned: 0 in 0.245s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:43:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:43:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d19a6b-9eec-407b-952e-46a47ef4a1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4c5b5ad-7018-4aa3-808a-6119fd912f84', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86cff79e-3dd5-4d3f-ad0c-cd80ddb06d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:04 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Volume volume-a4c5b5ad-7018-4aa3-808a-6119fd912f84 (a4c5b5ad-7018-4aa3-808a-6119fd912f84): created successfully Aug 05 10:43:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86cff79e-3dd5-4d3f-ad0c-cd80ddb06d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Flow 'volume_create_manager' (2f9276b6-2569-4c38-8dc8-1e283a516ed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:43:04 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-36b67009-b68b-4043-ac7a-8407fce04520 tempest-ProjectReaderTests-188570171 None] Created volume successfully. Aug 05 10:43:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] Acquiring lock "cinder-a4c5b5ad-7018-4aa3-808a-6119fd912f84-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:43:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] Lock "cinder-a4c5b5ad-7018-4aa3-808a-6119fd912f84-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:43:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] Acquiring lock "cinder-quobyte-a4c5b5ad-7018-4aa3-808a-6119fd912f84" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:43:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] Lock "cinder-quobyte-a4c5b5ad-7018-4aa3-808a-6119fd912f84" acquired by "delete_volume" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:43:04 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[575f4b70-639c-4c10-9c15-ee7e1d8ada38]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:43:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a4c5b5ad-7018-4aa3-808a-6119fd912f84 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:04 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a4c5b5ad-7018-4aa3-808a-6119fd912f84 Aug 05 10:43:04 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:05 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a4c5b5ad-7018-4aa3-808a-6119fd912f84" returned: 0 in 0.355s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a4c5b5ad-7018-4aa3-808a-6119fd912f84 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:05 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a4c5b5ad-7018-4aa3-808a-6119fd912f84 Aug 05 10:43:05 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:05 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a4c5b5ad-7018-4aa3-808a-6119fd912f84" returned: 0 in 0.251s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] Lock "cinder-quobyte-a4c5b5ad-7018-4aa3-808a-6119fd912f84" released by "delete_volume" :: held 0.645s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:43:05 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] Created reservations ['064d2812-ec72-4aa8-b28d-dfce7f4c2f79', '76eaab8f-229c-4d2e-ae8d-cc4483d0a453', 'aba512f2-e16b-4c70-91d4-98739a31f814', '96ebd481-02ba-4189-b0fd-0f8b287786dd'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:43:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:43:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:43:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:43:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:43:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:43:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:05 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:43:05 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:05 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.244s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:05 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:43:05 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] Deleted volume successfully. Aug 05 10:43:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-812bfcf1-b794-4097-8d6f-7c433852372e tempest-ProjectReaderTests-188570171 None] Lock "cinder-a4c5b5ad-7018-4aa3-808a-6119fd912f84-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:43:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:43:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:43:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:43:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:43:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:43:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:43:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:13 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:43:13 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:14 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.304s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:43:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:43:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:43:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:43:15 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=108,cinder:INSERT=36,cinder:UPDATE=154,cinder:DELETE=14 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:43:15 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-b2e50d37-db30-4fcb-84ad-63793e3fe498 tempest-TestShelveInstance-446779605 None] Terminate volume connection completed successfully. Aug 05 10:43:15 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-b2e50d37-db30-4fcb-84ad-63793e3fe498 tempest-TestShelveInstance-446779605 None] Deleting attachment 71158aac-d270-42fb-b67f-8e444d9f8a61. {{(pid=88736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 10:43:15 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] Acquiring lock "cinder-614407cd-88e1-4654-ad75-9387d3545c76-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:43:15 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] Lock "cinder-614407cd-88e1-4654-ad75-9387d3545c76-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:43:15 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] Acquiring lock "cinder-quobyte-614407cd-88e1-4654-ad75-9387d3545c76" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:43:15 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] Lock "cinder-quobyte-614407cd-88e1-4654-ad75-9387d3545c76" acquired by "delete_volume" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:43:15 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbba910-7e34-4d11-8c0f-25f95a570f34]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:43:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:15 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76 Aug 05 10:43:15 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:16 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76" returned: 0 in 0.411s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:16 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76 Aug 05 10:43:16 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:16 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-614407cd-88e1-4654-ad75-9387d3545c76" returned: 0 in 0.254s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] Lock "cinder-quobyte-614407cd-88e1-4654-ad75-9387d3545c76" released by "delete_volume" :: held 0.705s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:43:16 devstack cinder-volume[88736]: DEBUG cinder.quota [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] Created reservations ['fb0cc89d-a121-45c2-9e7a-8e5aded4cb04', 'f6258adf-a43e-4487-9b0a-a7cee4844212', '5b10f783-6d44-49c1-a689-4c64c29dd5ab', '53c965c4-d3b1-4df2-b6a0-c2664f11ef57'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:43:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:43:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:43:16 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:43:16 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:43:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:43:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:16 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:43:16 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:16 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.279s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:16 devstack cinder-volume[88736]: DEBUG cinder.manager [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:43:16 devstack cinder-volume[88736]: INFO cinder.volume.manager [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] Deleted volume successfully. Aug 05 10:43:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [req-a82e8af2-f702-4aab-b1a1-46bcbce43266 req-f7cdb8b4-e40c-4d7f-a8b7-73a59de4012a tempest-TestShelveInstance-446779605 None] Lock "cinder-614407cd-88e1-4654-ad75-9387d3545c76-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:43:26 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:INSERT=38,cinder:UPDATE=162,cinder:SELECT=110,cinder:DELETE=12 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:43:26 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:UPDATE=9,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Flow 'volume_create_manager' (5b86c2be-9b8b-4c3f-b531-c93b67c803c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc62b1ba-ed10-47d5-b65e-102f3a61e5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc62b1ba-ed10-47d5-b65e-102f3a61e5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-699703816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa075181a9744b2aa97f527a8f0503d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:43:43Z,use_quota=True,user_id='0a737edab7314e9eb25f6a57b4399869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4836e5-de78-4e39-8531-3ab8ed795bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4836e5-de78-4e39-8531-3ab8ed795bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69c08e3-5386-4abc-8b09-357480e13e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69c08e3-5386-4abc-8b09-357480e13e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586', 'volume_name': 'volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa9e649-a983-4894-a3f6-78b0c22e720c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa9e649-a983-4894-a3f6-78b0c22e720c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dadc7f3-e880-4519-86cd-e42998b6378c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:43 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Volume 7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586', 'volume_size': 1} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-699703816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa075181a9744b2aa97f527a8f0503d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:43:43Z,use_quota=True,user_id='0a737edab7314e9eb25f6a57b4399869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Creating volume 7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:43:43 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:43 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 1073741824 Aug 05 10:43:43 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:43 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 1073741824" returned: 0 in 0.402s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:43 devstack sudo[108763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 Aug 05 10:43:43 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:44 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586" returned: 0 in 0.247s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:43:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:43:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dadc7f3-e880-4519-86cd-e42998b6378c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c76e959-a5ab-441d-9376-eae3e353e309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:43:44 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Volume volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 (7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586): created successfully Aug 05 10:43:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c76e959-a5ab-441d-9376-eae3e353e309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:43:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Flow 'volume_create_manager' (5b86c2be-9b8b-4c3f-b531-c93b67c803c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:43:44 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b34382d6-eec0-4456-b0b9-0354e0fd8f2b tempest-TestImageHashVerification-1521280348 None] Created volume successfully. Aug 05 10:43:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-673808c4-366b-4d90-af4d-985485327713 tempest-TestImageHashVerification-1521280348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:43:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-673808c4-366b-4d90-af4d-985485327713 tempest-TestImageHashVerification-1521280348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:43:45 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[696f0f75-2a83-48fe-bc4f-303c989460a0]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:43:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-673808c4-366b-4d90-af4d-985485327713 tempest-TestImageHashVerification-1521280348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:45 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 Aug 05 10:43:45 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:45 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-673808c4-366b-4d90-af4d-985485327713 tempest-TestImageHashVerification-1521280348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586" returned: 0 in 0.350s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:45 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77210fd-98fd-49fe-9742-7d0451985575]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:43:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-673808c4-366b-4d90-af4d-985485327713 tempest-TestImageHashVerification-1521280348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:45 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 Aug 05 10:43:45 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:45 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-673808c4-366b-4d90-af4d-985485327713 tempest-TestImageHashVerification-1521280348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586" returned: 0 in 0.346s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-673808c4-366b-4d90-af4d-985485327713 tempest-TestImageHashVerification-1521280348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 /opt/stack/data/cinder/conversion/7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586.temp_image.6e92e430-8a8a-4792-abe6-3cd5e7693f6a1200zuqu.img {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:45 devstack sudo[108782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 /opt/stack/data/cinder/conversion/7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586.temp_image.6e92e430-8a8a-4792-abe6-3cd5e7693f6a1200zuqu.img Aug 05 10:43:45 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:49 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-673808c4-366b-4d90-af4d-985485327713 tempest-TestImageHashVerification-1521280348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 /opt/stack/data/cinder/conversion/7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586.temp_image.6e92e430-8a8a-4792-abe6-3cd5e7693f6a1200zuqu.img" returned: 0 in 3.953s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:49 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd55d9b8-e99a-4f9d-b0fe-99467951bb3f]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:43:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-673808c4-366b-4d90-af4d-985485327713 tempest-TestImageHashVerification-1521280348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:43:49 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 Aug 05 10:43:49 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:43:50 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Aug 05 10:43:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-673808c4-366b-4d90-af4d-985485327713 tempest-TestImageHashVerification-1521280348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586" returned: 0 in 0.538s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:43:50 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-673808c4-366b-4d90-af4d-985485327713 tempest-TestImageHashVerification-1521280348 None] Image conversion details: src /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586, size 1024.00 MB, duration 3.95 sec, destination /opt/stack/data/cinder/conversion/7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586.temp_image.6e92e430-8a8a-4792-abe6-3cd5e7693f6a1200zuqu.img {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:43:50 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-673808c4-366b-4d90-af4d-985485327713 tempest-TestImageHashVerification-1521280348 None] Converted 1024.00 MB image at 258.99 MB/s Aug 05 10:43:50 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-673808c4-366b-4d90-af4d-985485327713 tempest-TestImageHashVerification-1521280348 None] 6e92e430-8a8a-4792-abe6-3cd5e7693f6a was raw, no need to convert to raw {{(pid=88736) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 05 10:44:06 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:44:06 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:44:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-673808c4-366b-4d90-af4d-985485327713 tempest-TestImageHashVerification-1521280348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.750s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-673808c4-366b-4d90-af4d-985485327713 tempest-TestImageHashVerification-1521280348 None] Uploaded volume to glance image-id: 6e92e430-8a8a-4792-abe6-3cd5e7693f6a. {{(pid=88736) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 05 10:44:08 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-673808c4-366b-4d90-af4d-985485327713 tempest-TestImageHashVerification-1521280348 None] Copy volume to image completed successfully. Aug 05 10:44:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] Acquiring lock "cinder-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] Lock "cinder-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] Acquiring lock "cinder-quobyte-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] Lock "cinder-quobyte-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586" acquired by "delete_volume" :: waited 0.014s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:09 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9004da45-55bb-4528-84da-80d082396544]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:09 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 Aug 05 10:44:09 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:09 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586" returned: 0 in 0.349s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:09 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586 Aug 05 10:44:09 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:10 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586" returned: 0 in 0.246s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] Lock "cinder-quobyte-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586" released by "delete_volume" :: held 0.635s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:10 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] Created reservations ['f2b6fa35-5f1d-4509-b0dc-38584d1822a0', '448ad364-3b68-4dd3-87b8-93739ef5c4f8', '843a8dad-ef94-492a-97ca-7308af53abbb', '4da9d2c0-53c9-40c8-8598-2d840df771ea'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:44:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:10 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:44:10 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:10 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.240s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:10 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:44:10 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] Deleted volume successfully. Aug 05 10:44:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f9be71b2-2a56-4475-af7e-ea3c604e87dd tempest-TestImageHashVerification-1521280348 None] Lock "cinder-7b9d4ad1-8af2-4809-a6fa-a5e8acd6d586-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:44:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:13 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:44:13 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:14 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.261s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:44:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:44:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:44:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:44:20 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=3 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:44:20 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Flow 'volume_create_manager' (4e3e030a-d41e-4353-9a22-2762109f440f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f95e3bf-4c55-4765-bcad-5b7e9acec1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f95e3bf-4c55-4765-bcad-5b7e9acec1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2033308326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95bbc326-7cfa-4cb4-9e0b-fa80c439501c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257331b239c64c398530524958798263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:33Z,use_quota=True,user_id='f0b1cfa394ed40d981746e24425293e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86228ee-93ae-4184-a8fc-acc3a67708bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86228ee-93ae-4184-a8fc-acc3a67708bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27920490-b627-425e-8305-955465c1bf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27920490-b627-425e-8305-955465c1bf63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95bbc326-7cfa-4cb4-9e0b-fa80c439501c', 'volume_name': 'volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99131dc-1ff4-4a0a-91f7-e6249c319f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99131dc-1ff4-4a0a-91f7-e6249c319f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc034ba9-5048-49f5-82ef-bde9ff167582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:33 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume 95bbc326-7cfa-4cb4-9e0b-fa80c439501c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c', 'volume_size': 1} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2033308326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95bbc326-7cfa-4cb4-9e0b-fa80c439501c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257331b239c64c398530524958798263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:33Z,use_quota=True,user_id='f0b1cfa394ed40d981746e24425293e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Creating volume 95bbc326-7cfa-4cb4-9e0b-fa80c439501c {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:44:33 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:33 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c 1073741824 Aug 05 10:44:33 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Flow 'volume_create_manager' (98afdd43-4244-4891-a051-2300e46e1aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2515100a-8541-4d19-ab79-627491a75e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-207f4930-471e-4ecf-a70e-3afcde16bfc7 tempest-ProjectAdminTests-1457467995 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6894226074219, 'free_capacity_gb': 1775.6894226074219, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88736) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2515100a-8541-4d19-ab79-627491a75e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1656195619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36782676-367a-4ff6-9b76-72271027d8ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d206779fd24785959023cb982818be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:33Z,use_quota=True,user_id='c89fda43211742fca5dfa28062dd67e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbbc96dd-58c3-40a3-865b-7496fe8a7a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbbc96dd-58c3-40a3-865b-7496fe8a7a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677177ff-7db2-4f9b-982f-c1c777955ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677177ff-7db2-4f9b-982f-c1c777955ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36782676-367a-4ff6-9b76-72271027d8ab', 'volume_name': 'volume-36782676-367a-4ff6-9b76-72271027d8ab', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0fa17a-0474-47de-8ada-1699374945cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0fa17a-0474-47de-8ada-1699374945cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494bdd5a-36b7-4571-863d-2abee07b96f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:33 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Volume 36782676-367a-4ff6-9b76-72271027d8ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36782676-367a-4ff6-9b76-72271027d8ab', 'volume_size': 1} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:33 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c 1073741824" returned: 0 in 0.636s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:33 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c Aug 05 10:44:33 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:34 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c" returned: 0 in 0.406s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.616s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1656195619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36782676-367a-4ff6-9b76-72271027d8ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d206779fd24785959023cb982818be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:33Z,use_quota=True,user_id='c89fda43211742fca5dfa28062dd67e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Creating volume 36782676-367a-4ff6-9b76-72271027d8ab {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:44:34 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-36782676-367a-4ff6-9b76-72271027d8ab 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc034ba9-5048-49f5-82ef-bde9ff167582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7137d7a-a856-4876-a41c-a1beefd4f3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:34 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-36782676-367a-4ff6-9b76-72271027d8ab 1073741824 Aug 05 10:44:34 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:34 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c (95bbc326-7cfa-4cb4-9e0b-fa80c439501c): created successfully Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7137d7a-a856-4876-a41c-a1beefd4f3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Flow 'volume_create_manager' (4e3e030a-d41e-4353-9a22-2762109f440f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Flow 'volume_create_manager' (1c1c8066-4a7c-4ca4-ae9a-34b06605c11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f132c0bb-881b-4543-92d7-9bb389c5288b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:34 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-f8f8f3e0-7627-4427-b071-8f32bce6c1fa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Created volume successfully. Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f132c0bb-881b-4543-92d7-9bb389c5288b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-587138014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d6f7d5-f201-41af-a70b-b8e34d031c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d206779fd24785959023cb982818be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:34Z,use_quota=True,user_id='c89fda43211742fca5dfa28062dd67e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2040547b-6902-485f-8fd5-862bdc3405ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2040547b-6902-485f-8fd5-862bdc3405ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb30f2d-7eb9-42a5-bef5-b5746078fc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb30f2d-7eb9-42a5-bef5-b5746078fc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09d6f7d5-f201-41af-a70b-b8e34d031c4c', 'volume_name': 'volume-09d6f7d5-f201-41af-a70b-b8e34d031c4c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (210f8507-04c3-4649-9c04-7f7e1e5d1641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (210f8507-04c3-4649-9c04-7f7e1e5d1641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c0d9f3-6ffc-4adc-b2c8-8368fbabd1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:34 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Volume 09d6f7d5-f201-41af-a70b-b8e34d031c4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09d6f7d5-f201-41af-a70b-b8e34d031c4c', 'volume_size': 1} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Flow 'volume_create_manager' (e50a6802-508d-44f0-adb8-b61532b755d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e19842a-fe65-429a-a711-863f8052ea48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e19842a-fe65-429a-a711-863f8052ea48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1728785550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bff8d55-0fbc-48f3-9396-936e58258078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d206779fd24785959023cb982818be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:35Z,use_quota=True,user_id='c89fda43211742fca5dfa28062dd67e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d84047-a337-4e88-8cfa-703f9ceb05c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d84047-a337-4e88-8cfa-703f9ceb05c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7008d9c-0409-4589-9b24-afc4283b9525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7008d9c-0409-4589-9b24-afc4283b9525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bff8d55-0fbc-48f3-9396-936e58258078', 'volume_name': 'volume-8bff8d55-0fbc-48f3-9396-936e58258078', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b26004-4b48-440f-abb4-72374a886a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b26004-4b48-440f-abb4-72374a886a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9088f55-bbb8-468b-aaa2-210dc6473a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:34 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Volume 8bff8d55-0fbc-48f3-9396-936e58258078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bff8d55-0fbc-48f3-9396-936e58258078', 'volume_size': 1} Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:34 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-36782676-367a-4ff6-9b76-72271027d8ab 1073741824" returned: 0 in 0.714s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-36782676-367a-4ff6-9b76-72271027d8ab {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:35 devstack sudo[108881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-36782676-367a-4ff6-9b76-72271027d8ab Aug 05 10:44:35 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:35 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-36782676-367a-4ff6-9b76-72271027d8ab" returned: 0 in 0.580s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-587138014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d6f7d5-f201-41af-a70b-b8e34d031c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d206779fd24785959023cb982818be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:34Z,use_quota=True,user_id='c89fda43211742fca5dfa28062dd67e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Creating volume 09d6f7d5-f201-41af-a70b-b8e34d031c4c {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:44:35 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-09d6f7d5-f201-41af-a70b-b8e34d031c4c 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:35 devstack sudo[108919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-09d6f7d5-f201-41af-a70b-b8e34d031c4c 1073741824 Aug 05 10:44:35 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494bdd5a-36b7-4571-863d-2abee07b96f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36782676-367a-4ff6-9b76-72271027d8ab', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d3b735-6f15-47ba-98e0-8447607dd6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:35 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Volume volume-36782676-367a-4ff6-9b76-72271027d8ab (36782676-367a-4ff6-9b76-72271027d8ab): created successfully Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d3b735-6f15-47ba-98e0-8447607dd6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Flow 'volume_create_manager' (98afdd43-4244-4891-a051-2300e46e1aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:35 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b8681845-5f3c-4695-8214-bf737b94ba04 tempest-CreateVolumesFromImageTest-1675288603 None] Created volume successfully. Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Flow 'volume_create_manager' (d810a99d-79b8-4ce4-b73f-f5f6d5d3c56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24418608-3e97-4771-9a74-1a62fa47e627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24418608-3e97-4771-9a74-1a62fa47e627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1491485053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd17b4c-8a5d-4705-81a8-be8de7a3e379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d206779fd24785959023cb982818be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:36Z,use_quota=True,user_id='c89fda43211742fca5dfa28062dd67e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7938f7a-029e-424e-9625-35c2bca53c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7938f7a-029e-424e-9625-35c2bca53c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfe9cb0-dce1-4503-baed-49ffc2e3411f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfe9cb0-dce1-4503-baed-49ffc2e3411f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd17b4c-8a5d-4705-81a8-be8de7a3e379', 'volume_name': 'volume-ddd17b4c-8a5d-4705-81a8-be8de7a3e379', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3642dba8-bd9a-49d9-bdb6-6e57bce83661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3642dba8-bd9a-49d9-bdb6-6e57bce83661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891f1ebb-16cc-4489-ac1e-226d234604d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:36 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Volume ddd17b4c-8a5d-4705-81a8-be8de7a3e379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd17b4c-8a5d-4705-81a8-be8de7a3e379', 'volume_size': 1} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Flow 'volume_create_manager' (89a89abc-2869-469e-8f5d-2c8aac226fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b89064-1e7f-46e7-9ea7-caeb5bbe2f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b89064-1e7f-46e7-9ea7-caeb5bbe2f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1948478843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c645eba-ab2b-40b8-ba38-dcfabd6e95df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d206779fd24785959023cb982818be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:36Z,use_quota=True,user_id='c89fda43211742fca5dfa28062dd67e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8584bcf5-e666-4130-adec-d0f4c1cdd7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8584bcf5-e666-4130-adec-d0f4c1cdd7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253778e2-ed9c-4cc3-be22-ef811971fa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253778e2-ed9c-4cc3-be22-ef811971fa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c645eba-ab2b-40b8-ba38-dcfabd6e95df', 'volume_name': 'volume-4c645eba-ab2b-40b8-ba38-dcfabd6e95df', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2184a4-ac00-4d5d-bde3-3915864eec09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2184a4-ac00-4d5d-bde3-3915864eec09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad605685-4e0d-41a6-957a-5ef29543605f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:36 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Volume 4c645eba-ab2b-40b8-ba38-dcfabd6e95df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c645eba-ab2b-40b8-ba38-dcfabd6e95df', 'volume_size': 1} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:36 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-09d6f7d5-f201-41af-a70b-b8e34d031c4c 1073741824" returned: 0 in 0.676s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-09d6f7d5-f201-41af-a70b-b8e34d031c4c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:36 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-09d6f7d5-f201-41af-a70b-b8e34d031c4c Aug 05 10:44:36 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:36 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-09d6f7d5-f201-41af-a70b-b8e34d031c4c" returned: 0 in 0.273s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.727s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1728785550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bff8d55-0fbc-48f3-9396-936e58258078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d206779fd24785959023cb982818be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:35Z,use_quota=True,user_id='c89fda43211742fca5dfa28062dd67e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Creating volume 8bff8d55-0fbc-48f3-9396-936e58258078 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:44:36 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8bff8d55-0fbc-48f3-9396-936e58258078 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c0d9f3-6ffc-4adc-b2c8-8368fbabd1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09d6f7d5-f201-41af-a70b-b8e34d031c4c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbb4e82-92da-4d90-b83e-b6bcb73ab25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:36 devstack sudo[108932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8bff8d55-0fbc-48f3-9396-936e58258078 1073741824 Aug 05 10:44:36 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:36 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Volume volume-09d6f7d5-f201-41af-a70b-b8e34d031c4c (09d6f7d5-f201-41af-a70b-b8e34d031c4c): created successfully Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbb4e82-92da-4d90-b83e-b6bcb73ab25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Flow 'volume_create_manager' (1c1c8066-4a7c-4ca4-ae9a-34b06605c11d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:36 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-141863ac-d3e2-48d1-b39f-262663b815e5 tempest-CreateVolumesFromImageTest-1675288603 None] Created volume successfully. Aug 05 10:44:37 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8bff8d55-0fbc-48f3-9396-936e58258078 1073741824" returned: 0 in 0.552s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8bff8d55-0fbc-48f3-9396-936e58258078 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:37 devstack sudo[108938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8bff8d55-0fbc-48f3-9396-936e58258078 Aug 05 10:44:37 devstack sudo[108938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:37 devstack sudo[108938]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8bff8d55-0fbc-48f3-9396-936e58258078" returned: 0 in 0.284s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:37 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:44:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.686s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:37 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] Creating offline snapshot 8f4a8caf-ead4-4b98-a8fd-724aeb73e158 of volume 95bbc326-7cfa-4cb4-9e0b-fa80c439501c {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:44:37 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9088f55-bbb8-468b-aaa2-210dc6473a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bff8d55-0fbc-48f3-9396-936e58258078', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:37 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76be97b3-32e2-4b2f-a956-ec6b1e5a5eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:37 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4e773a-2ce3-46b7-b930-d01a105e39cd]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:37 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Volume volume-8bff8d55-0fbc-48f3-9396-936e58258078 (8bff8d55-0fbc-48f3-9396-936e58258078): created successfully Aug 05 10:44:37 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76be97b3-32e2-4b2f-a956-ec6b1e5a5eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:37 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Flow 'volume_create_manager' (e50a6802-508d-44f0-adb8-b61532b755d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:37 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-31bb8531-7a89-4fb4-9e8c-c2052ba73861 tempest-CreateVolumesFromImageTest-1675288603 None] Created volume successfully. Aug 05 10:44:37 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c Aug 05 10:44:37 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:38 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c" returned: 0 in 0.445s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:38 devstack sudo[108946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158 1G Aug 05 10:44:38 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:38 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158 1G" returned: 0 in 0.521s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:38 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158 Aug 05 10:44:38 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:38 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Flow 'volume_create_manager' (90ca4449-d9dd-4035-acdb-ce788cf25ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18866aa2-8467-47f5-805f-b8b3bff3199c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18866aa2-8467-47f5-805f-b8b3bff3199c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e05493-7826-451f-8dc3-2a298514f4c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752c6d81dc0b496cae4b6810e797cef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:39Z,use_quota=True,user_id='c3798941c1b64c648f3891f9a1bdef9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d890416-84db-4b79-a8d5-0e5186d37631),volume_type_id=4d890416-84db-4b79-a8d5-0e5186d37631)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aba9908-fa15-4501-921a-4b5725e87c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aba9908-fa15-4501-921a-4b5725e87c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1584b668-65f1-44f5-bec5-b9fef0fa4151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:38 devstack cinder-volume[88736]: DEBUG cinder.image.glance [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Creating Keystone auth plugin from conf {{(pid=88736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:44:38 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158" returned: 0 in 0.343s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:38 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158 is being set with open permissions: ugo+rw Aug 05 10:44:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:38 devstack sudo[108960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158 Aug 05 10:44:38 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:39 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158" returned: 0 in 0.294s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:39 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.info Aug 05 10:44:39 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1584b668-65f1-44f5-bec5-b9fef0fa4151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '63e05493-7826-451f-8dc3-2a298514f4c2', 'volume_name': 'volume-63e05493-7826-451f-8dc3-2a298514f4c2', 'volume_size': 1, 'image_id': 'f7524352-a65b-4797-a4b6-f14ce9c8bd65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7524352-a65b-4797-a4b6-f14ce9c8bd65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b52e62c9f0e82bf9841a6bbe05864bc1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '752c6d81dc0b496cae4b6810e797cef9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b55687358556d40f55e5f1143f4faba2d356e19870e91c36a74e90647f2622678ac541882415735756c8c2cf39993d11c1eb35b425bd4ac7342a9edcb5ef11dc', 'id': 'f7524352-a65b-4797-a4b6-f14ce9c8bd65', 'created_at': datetime.datetime(2026, 8, 5, 8, 44, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 44, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7524352-a65b-4797-a4b6-f14ce9c8bd65/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdd2a9a-4bde-47b3-9fdb-afe0156357fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdd2a9a-4bde-47b3-9fdb-afe0156357fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ad60bd-b10a-448c-adfe-b93f32eb6666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:39 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Volume 63e05493-7826-451f-8dc3-2a298514f4c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-63e05493-7826-451f-8dc3-2a298514f4c2', 'volume_size': 1, 'image_id': 'f7524352-a65b-4797-a4b6-f14ce9c8bd65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7524352-a65b-4797-a4b6-f14ce9c8bd65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b52e62c9f0e82bf9841a6bbe05864bc1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '752c6d81dc0b496cae4b6810e797cef9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b55687358556d40f55e5f1143f4faba2d356e19870e91c36a74e90647f2622678ac541882415735756c8c2cf39993d11c1eb35b425bd4ac7342a9edcb5ef11dc', 'id': 'f7524352-a65b-4797-a4b6-f14ce9c8bd65', 'created_at': datetime.datetime(2026, 8, 5, 8, 44, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 44, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7524352-a65b-4797-a4b6-f14ce9c8bd65/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Trying to clone 63e05493-7826-451f-8dc3-2a298514f4c2 from image f7524352-a65b-4797-a4b6-f14ce9c8bd65 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f7524352-a65b-4797-a4b6-f14ce9c8bd65', 'metadata': {}}]). {{(pid=88736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:44:39 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Image download 0.00 MB at 0.00 MB/s Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[801ca91e-4ccc-4aad-803f-884117cf1197]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:39 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.info" returned: 0 in 0.294s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:39 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.info is being set with open permissions: ugo+rw Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:39 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.info Aug 05 10:44:39 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:39 devstack sudo[108966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD Aug 05 10:44:39 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:39 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.info" returned: 0 in 0.278s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.290s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.734s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1491485053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd17b4c-8a5d-4705-81a8-be8de7a3e379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d206779fd24785959023cb982818be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:36Z,use_quota=True,user_id='c89fda43211742fca5dfa28062dd67e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Creating volume ddd17b4c-8a5d-4705-81a8-be8de7a3e379 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:44:39 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ddd17b4c-8a5d-4705-81a8-be8de7a3e379 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:39 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:39 devstack sudo[108973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ddd17b4c-8a5d-4705-81a8-be8de7a3e379 1073741824 Aug 05 10:44:39 devstack sudo[108973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:39 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-4d7f9fe5-b4e9-49a0-942a-e51fcaf10dff tempest-CreateVolumesFromSnapshotTest-1619322295 None] Create snapshot completed successfully Aug 05 10:44:40 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD Aug 05 10:44:40 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:40 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Temporary image f7524352-a65b-4797-a4b6-f14ce9c8bd65 is fetched for user c3798941c1b64c648f3891f9a1bdef9f. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db4cd82-2b4a-43c8-b057-b0410031e9e9]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:40 devstack sudo[108973]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ddd17b4c-8a5d-4705-81a8-be8de7a3e379 1073741824" returned: 0 in 0.480s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ddd17b4c-8a5d-4705-81a8-be8de7a3e379 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:40 devstack sudo[108985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ddd17b4c-8a5d-4705-81a8-be8de7a3e379 Aug 05 10:44:40 devstack sudo[108985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:40 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD Aug 05 10:44:40 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:40 devstack sudo[108985]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ddd17b4c-8a5d-4705-81a8-be8de7a3e379" returned: 0 in 0.315s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.476s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1948478843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c645eba-ab2b-40b8-ba38-dcfabd6e95df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d206779fd24785959023cb982818be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:36Z,use_quota=True,user_id='c89fda43211742fca5dfa28062dd67e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Creating volume 4c645eba-ab2b-40b8-ba38-dcfabd6e95df {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:44:40 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4c645eba-ab2b-40b8-ba38-dcfabd6e95df 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:40 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:40 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4c645eba-ab2b-40b8-ba38-dcfabd6e95df 1073741824 Aug 05 10:44:40 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891f1ebb-16cc-4489-ac1e-226d234604d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd17b4c-8a5d-4705-81a8-be8de7a3e379', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70673f64-d852-4cdb-b04a-197faded0e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:40 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Volume volume-ddd17b4c-8a5d-4705-81a8-be8de7a3e379 (ddd17b4c-8a5d-4705-81a8-be8de7a3e379): created successfully Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70673f64-d852-4cdb-b04a-197faded0e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Flow 'volume_create_manager' (d810a99d-79b8-4ce4-b73f-f5f6d5d3c56d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:40 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-698d0a58-7dca-4083-8d9f-da318444e48e tempest-CreateVolumesFromImageTest-1675288603 None] Created volume successfully. Aug 05 10:44:40 devstack sudo[108993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD Aug 05 10:44:40 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:41 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD" returned: 1 in 0.518s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:41 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4c645eba-ab2b-40b8-ba38-dcfabd6e95df 1073741824" returned: 0 in 0.629s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Flow 'volume_create_manager' (9bc897de-966b-43d2-8211-afbb0bea19d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8761355-f6bc-410d-957b-f8f6d5cca700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8761355-f6bc-410d-957b-f8f6d5cca700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-201771856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69bb91d-d514-478c-acc6-625fa39b66ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257331b239c64c398530524958798263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:41Z,use_quota=True,user_id='f0b1cfa394ed40d981746e24425293e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7991a09f-9d29-4eb3-a205-9fcd4b726c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7991a09f-9d29-4eb3-a205-9fcd4b726c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963e17b3-50e8-4a19-ade3-32fc6093122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963e17b3-50e8-4a19-ade3-32fc6093122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f69bb91d-d514-478c-acc6-625fa39b66ac', 'volume_name': 'volume-f69bb91d-d514-478c-acc6-625fa39b66ac', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888d83a6-ce95-4dcd-b92d-b6a0703f56bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888d83a6-ce95-4dcd-b92d-b6a0703f56bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bbcd946-7b97-408f-a65e-f2129a3809af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:41 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume f69bb91d-d514-478c-acc6-625fa39b66ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f69bb91d-d514-478c-acc6-625fa39b66ac', 'volume_size': 1} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4c645eba-ab2b-40b8-ba38-dcfabd6e95df {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:41 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4c645eba-ab2b-40b8-ba38-dcfabd6e95df Aug 05 10:44:41 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:41 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4c645eba-ab2b-40b8-ba38-dcfabd6e95df" returned: 0 in 0.309s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.531s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e05493-7826-451f-8dc3-2a298514f4c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752c6d81dc0b496cae4b6810e797cef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:39Z,use_quota=True,user_id='c3798941c1b64c648f3891f9a1bdef9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d890416-84db-4b79-a8d5-0e5186d37631),volume_type_id=4d890416-84db-4b79-a8d5-0e5186d37631)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Creating volume 63e05493-7826-451f-8dc3-2a298514f4c2 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:44:41 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad605685-4e0d-41a6-957a-5ef29543605f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c645eba-ab2b-40b8-ba38-dcfabd6e95df', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:41 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2 1073741824 Aug 05 10:44:41 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051accf7-7cfc-4964-be5e-2f3c7652d6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:41 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Volume volume-4c645eba-ab2b-40b8-ba38-dcfabd6e95df (4c645eba-ab2b-40b8-ba38-dcfabd6e95df): created successfully Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051accf7-7cfc-4964-be5e-2f3c7652d6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Flow 'volume_create_manager' (89a89abc-2869-469e-8f5d-2c8aac226fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:41 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-22daa117-6cbc-47af-8a20-32418cd7b97d tempest-CreateVolumesFromImageTest-1675288603 None] Created volume successfully. Aug 05 10:44:41 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Flow 'volume_create_manager' (618c5214-605c-49dc-ad81-a984aa8b4b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b79b804-c3d8-4d53-94b4-dacd5cbbae72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b79b804-c3d8-4d53-94b4-dacd5cbbae72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-747917103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1bb0db-7bfd-4462-af2f-727092f82c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257331b239c64c398530524958798263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:42Z,use_quota=True,user_id='f0b1cfa394ed40d981746e24425293e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9423b8d-45a0-4893-b53d-37b0af0aa5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9423b8d-45a0-4893-b53d-37b0af0aa5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0129dc9-c2bb-44b8-82dd-b6571a50501e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0129dc9-c2bb-44b8-82dd-b6571a50501e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a1bb0db-7bfd-4462-af2f-727092f82c59', 'volume_name': 'volume-2a1bb0db-7bfd-4462-af2f-727092f82c59', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6328d6d9-3c09-4df2-88d6-317cea6ebdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6328d6d9-3c09-4df2-88d6-317cea6ebdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a323408-ecf8-4738-9138-c58e9c794c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:42 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume 2a1bb0db-7bfd-4462-af2f-727092f82c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a1bb0db-7bfd-4462-af2f-727092f82c59', 'volume_size': 1} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Flow 'volume_create_manager' (8654cbd0-d99b-4928-a787-ada47a33e114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf5dc86-0cb9-4c73-93d1-fbb878a22fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf5dc86-0cb9-4c73-93d1-fbb878a22fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-990517866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb52e6d2-7975-402d-92c1-16640c2c5f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257331b239c64c398530524958798263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:42Z,use_quota=True,user_id='f0b1cfa394ed40d981746e24425293e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8eece0-2a53-4953-a15d-247bf96d7cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8eece0-2a53-4953-a15d-247bf96d7cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfbc166-80ad-4134-be22-53a7240ca550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfbc166-80ad-4134-be22-53a7240ca550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb52e6d2-7975-402d-92c1-16640c2c5f98', 'volume_name': 'volume-cb52e6d2-7975-402d-92c1-16640c2c5f98', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82aec1e1-604f-44ce-adbc-cded3a83b837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82aec1e1-604f-44ce-adbc-cded3a83b837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d4aa38-fb0d-48cd-990e-bf8d5e439c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:42 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume cb52e6d2-7975-402d-92c1-16640c2c5f98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb52e6d2-7975-402d-92c1-16640c2c5f98', 'volume_size': 1} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:42 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2 1073741824" returned: 0 in 0.606s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:42 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2 Aug 05 10:44:42 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Flow 'volume_create_manager' (3a6723c7-de04-4bb4-89dd-9c80176914ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7dd17dd-7780-4a66-a85b-54a3e9c578a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7dd17dd-7780-4a66-a85b-54a3e9c578a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1421283183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c461e18-331d-424c-a8b7-cd116ac59bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257331b239c64c398530524958798263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:43Z,use_quota=True,user_id='f0b1cfa394ed40d981746e24425293e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:42 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cab1b6-60ce-4dd0-bae2-e28ba01897d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cab1b6-60ce-4dd0-bae2-e28ba01897d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed88a949-cba0-41fc-ac18-b4cb811c841d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed88a949-cba0-41fc-ac18-b4cb811c841d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c461e18-331d-424c-a8b7-cd116ac59bb5', 'volume_name': 'volume-6c461e18-331d-424c-a8b7-cd116ac59bb5', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a1cd80-fd6a-4752-beea-08f8501ed1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a1cd80-fd6a-4752-beea-08f8501ed1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6783dd01-a638-4332-bf9e-12bf5ccc977b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:42 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume 6c461e18-331d-424c-a8b7-cd116ac59bb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c461e18-331d-424c-a8b7-cd116ac59bb5', 'volume_size': 1} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2" returned: 0 in 0.325s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.308s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-201771856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69bb91d-d514-478c-acc6-625fa39b66ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257331b239c64c398530524958798263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:41Z,use_quota=True,user_id='f0b1cfa394ed40d981746e24425293e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Creating volume f69bb91d-d514-478c-acc6-625fa39b66ac {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:44:42 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f69bb91d-d514-478c-acc6-625fa39b66ac 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:42 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f69bb91d-d514-478c-acc6-625fa39b66ac 1073741824 Aug 05 10:44:42 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Attempting download of f7524352-a65b-4797-a4b6-f14ce9c8bd65 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7524352-a65b-4797-a4b6-f14ce9c8bd65', 'metadata': {}}])) to volume 63e05493-7826-451f-8dc3-2a298514f4c2. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be5c5a0-6904-4ef5-a742-7333938bf3f3]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7524352-a65b-4797-a4b6-f14ce9c8bd65_xkmitu9a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:43 devstack sudo[109017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7524352-a65b-4797-a4b6-f14ce9c8bd65_xkmitu9a Aug 05 10:44:43 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "cinder-4c645eba-ab2b-40b8-ba38-dcfabd6e95df-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-4c645eba-ab2b-40b8-ba38-dcfabd6e95df-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Flow 'volume_create_manager' (10a7918a-3ffe-44dc-9372-566f99010459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1260e3b9-62b0-46b0-afa9-ce2392d080bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:43 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1260e3b9-62b0-46b0-afa9-ce2392d080bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1797455232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15ac94a-c999-40f7-b9ce-ff4719f9f8fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257331b239c64c398530524958798263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:43Z,use_quota=True,user_id='f0b1cfa394ed40d981746e24425293e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4972fe-e527-4612-9540-3639b487e5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4972fe-e527-4612-9540-3639b487e5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc78378-fa09-4c34-a5cd-a31bcd3517fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:43 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc78378-fa09-4c34-a5cd-a31bcd3517fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c15ac94a-c999-40f7-b9ce-ff4719f9f8fa', 'volume_name': 'volume-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18e51f9-f34d-4daf-9ce0-766f225d1c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18e51f9-f34d-4daf-9ce0-766f225d1c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758f172f-9da5-4f0a-9957-e1cbfcb66589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:43 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume c15ac94a-c999-40f7-b9ce-ff4719f9f8fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa', 'volume_size': 1} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "cinder-quobyte-4c645eba-ab2b-40b8-ba38-dcfabd6e95df" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f69bb91d-d514-478c-acc6-625fa39b66ac 1073741824" returned: 0 in 0.617s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7524352-a65b-4797-a4b6-f14ce9c8bd65_xkmitu9a" returned: 0 in 0.454s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7524352-a65b-4797-a4b6-f14ce9c8bd65_xkmitu9a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-quobyte-4c645eba-ab2b-40b8-ba38-dcfabd6e95df" acquired by "delete_volume" :: waited 0.038s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[07019cc6-37d7-4e42-8d1f-59b932b5762e]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4c645eba-ab2b-40b8-ba38-dcfabd6e95df {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f69bb91d-d514-478c-acc6-625fa39b66ac {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:43 devstack sudo[109025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7524352-a65b-4797-a4b6-f14ce9c8bd65_xkmitu9a Aug 05 10:44:43 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:43 devstack sudo[109027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f69bb91d-d514-478c-acc6-625fa39b66ac Aug 05 10:44:43 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:43 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4c645eba-ab2b-40b8-ba38-dcfabd6e95df Aug 05 10:44:43 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:43 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7524352-a65b-4797-a4b6-f14ce9c8bd65_xkmitu9a" returned: 1 in 0.359s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7524352-a65b-4797-a4b6-f14ce9c8bd65_xkmitu9a' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2314d254-2931-48a9-9e6c-236912e2cd4c]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:43 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f69bb91d-d514-478c-acc6-625fa39b66ac" returned: 0 in 0.265s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.675s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-747917103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1bb0db-7bfd-4462-af2f-727092f82c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257331b239c64c398530524958798263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:42Z,use_quota=True,user_id='f0b1cfa394ed40d981746e24425293e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Creating volume 2a1bb0db-7bfd-4462-af2f-727092f82c59 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:44:43 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a1bb0db-7bfd-4462-af2f-727092f82c59 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bbcd946-7b97-408f-a65e-f2129a3809af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69bb91d-d514-478c-acc6-625fa39b66ac', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dea67a2-e3a4-4496-84d9-467afedf7485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:43 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a1bb0db-7bfd-4462-af2f-727092f82c59 1073741824 Aug 05 10:44:43 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:43 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume volume-f69bb91d-d514-478c-acc6-625fa39b66ac (f69bb91d-d514-478c-acc6-625fa39b66ac): created successfully Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dea67a2-e3a4-4496-84d9-467afedf7485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Flow 'volume_create_manager' (9bc897de-966b-43d2-8211-afbb0bea19d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:43 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD Aug 05 10:44:43 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:43 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-38f5e98a-1c6f-40ec-9c28-0f76b6b64743 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Created volume successfully. Aug 05 10:44:43 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4c645eba-ab2b-40b8-ba38-dcfabd6e95df" returned: 0 in 0.448s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4c645eba-ab2b-40b8-ba38-dcfabd6e95df {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:43 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4c645eba-ab2b-40b8-ba38-dcfabd6e95df Aug 05 10:44:44 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:44 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:44 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4c645eba-ab2b-40b8-ba38-dcfabd6e95df" returned: 0 in 0.264s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-quobyte-4c645eba-ab2b-40b8-ba38-dcfabd6e95df" released by "delete_volume" :: held 0.783s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:44 devstack sudo[109048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD Aug 05 10:44:44 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] Created reservations ['64ff6643-87e5-4356-9259-c1bbec9f425a', '1e1c75c8-e4fd-45de-9d08-739e672bd640', '5e82324c-9b9e-4bbf-a004-fe427b12b175', '2151ebeb-0212-4c36-a9ce-94ef80951e69'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:44 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a1bb0db-7bfd-4462-af2f-727092f82c59 1073741824" returned: 0 in 0.575s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:44 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:44:44 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "cinder-ddd17b4c-8a5d-4705-81a8-be8de7a3e379-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a1bb0db-7bfd-4462-af2f-727092f82c59 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:44 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a1bb0db-7bfd-4462-af2f-727092f82c59 Aug 05 10:44:44 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-ddd17b4c-8a5d-4705-81a8-be8de7a3e379-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:44 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD" returned: 1 in 0.405s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] f7524352-a65b-4797-a4b6-f14ce9c8bd65 was raw, converting to qcow2 {{(pid=88736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:44 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2 Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "cinder-quobyte-ddd17b4c-8a5d-4705-81a8-be8de7a3e379" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:44 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-quobyte-ddd17b4c-8a5d-4705-81a8-be8de7a3e379" acquired by "delete_volume" :: waited 0.028s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[64946c91-0f22-4e78-99ce-a101f5ff5af9]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:44 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ddd17b4c-8a5d-4705-81a8-be8de7a3e379 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.331s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:44:44 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] Deleted volume successfully. Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00a176f0-bf0b-432f-b5e7-ae6b96bbd687 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-4c645eba-ab2b-40b8-ba38-dcfabd6e95df-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:44 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a1bb0db-7bfd-4462-af2f-727092f82c59" returned: 0 in 0.318s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.417s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-990517866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb52e6d2-7975-402d-92c1-16640c2c5f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257331b239c64c398530524958798263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:42Z,use_quota=True,user_id='f0b1cfa394ed40d981746e24425293e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Creating volume cb52e6d2-7975-402d-92c1-16640c2c5f98 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:44:44 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cb52e6d2-7975-402d-92c1-16640c2c5f98 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:44 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ddd17b4c-8a5d-4705-81a8-be8de7a3e379 Aug 05 10:44:44 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a323408-ecf8-4738-9138-c58e9c794c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a1bb0db-7bfd-4462-af2f-727092f82c59', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f55e87e-3652-4ff2-b867-d38b0d8fba41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:44 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cb52e6d2-7975-402d-92c1-16640c2c5f98 1073741824 Aug 05 10:44:44 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:44 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume volume-2a1bb0db-7bfd-4462-af2f-727092f82c59 (2a1bb0db-7bfd-4462-af2f-727092f82c59): created successfully Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f55e87e-3652-4ff2-b867-d38b0d8fba41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:44 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Flow 'volume_create_manager' (618c5214-605c-49dc-ad81-a984aa8b4b0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:44 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8d559849-9ccb-4f40-a2bf-4d9f5b8db9aa tempest-CreateVolumesFromSnapshotTest-1619322295 None] Created volume successfully. Aug 05 10:44:45 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ddd17b4c-8a5d-4705-81a8-be8de7a3e379" returned: 0 in 0.551s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ddd17b4c-8a5d-4705-81a8-be8de7a3e379 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:45 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2" returned: 0 in 0.707s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f7524352-a65b-4797-a4b6-f14ce9c8bd65_4v4qstxidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2 {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:44:45 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:45 devstack sudo[109083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ddd17b4c-8a5d-4705-81a8-be8de7a3e379 Aug 05 10:44:45 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:45 devstack sudo[109084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2 1G Aug 05 10:44:45 devstack sudo[109084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:45 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cb52e6d2-7975-402d-92c1-16640c2c5f98 1073741824" returned: 0 in 0.669s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cb52e6d2-7975-402d-92c1-16640c2c5f98 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:45 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cb52e6d2-7975-402d-92c1-16640c2c5f98 Aug 05 10:44:45 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:45 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ddd17b4c-8a5d-4705-81a8-be8de7a3e379" returned: 0 in 0.373s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-quobyte-ddd17b4c-8a5d-4705-81a8-be8de7a3e379" released by "delete_volume" :: held 1.012s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:45 devstack sudo[109084]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2 1G" returned: 0 in 0.429s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Downloaded image f7524352-a65b-4797-a4b6-f14ce9c8bd65 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7524352-a65b-4797-a4b6-f14ce9c8bd65', 'metadata': {}}])) to volume 63e05493-7826-451f-8dc3-2a298514f4c2 successfully. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Temporary image f7524352-a65b-4797-a4b6-f14ce9c8bd65 for user c3798941c1b64c648f3891f9a1bdef9f is deleted. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Marking volume 63e05493-7826-451f-8dc3-2a298514f4c2 as bootable. {{(pid=88736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Copying metadata from image f7524352-a65b-4797-a4b6-f14ce9c8bd65 to 63e05493-7826-451f-8dc3-2a298514f4c2. {{(pid=88736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Creating volume glance metadata for volume 63e05493-7826-451f-8dc3-2a298514f4c2 backed by image f7524352-a65b-4797-a4b6-f14ce9c8bd65 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f7524352-a65b-4797-a4b6-f14ce9c8bd65', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b52e62c9f0e82bf9841a6bbe05864bc1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] Created reservations ['cc522d2c-19ae-4b4f-98f9-28c2ac08a9c8', 'eacd3f9b-a5b6-4a74-8bfc-fe3e1cb675d9', 'f1ed4907-ced4-40d7-9a0d-34821238a61b', '4c8dd87f-a7f1-4fbd-b310-d2859700e8bf'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ad60bd-b10a-448c-adfe-b93f32eb6666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e05493-7826-451f-8dc3-2a298514f4c2', 'volume_size': 1, 'image_id': 'f7524352-a65b-4797-a4b6-f14ce9c8bd65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7524352-a65b-4797-a4b6-f14ce9c8bd65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b52e62c9f0e82bf9841a6bbe05864bc1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '752c6d81dc0b496cae4b6810e797cef9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b55687358556d40f55e5f1143f4faba2d356e19870e91c36a74e90647f2622678ac541882415735756c8c2cf39993d11c1eb35b425bd4ac7342a9edcb5ef11dc', 'id': 'f7524352-a65b-4797-a4b6-f14ce9c8bd65', 'created_at': datetime.datetime(2026, 8, 5, 8, 44, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 44, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7524352-a65b-4797-a4b6-f14ce9c8bd65/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:45 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09dbbe67-3e03-46bc-9786-306be3b96708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cb52e6d2-7975-402d-92c1-16640c2c5f98" returned: 0 in 0.333s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.087s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1421283183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c461e18-331d-424c-a8b7-cd116ac59bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257331b239c64c398530524958798263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:43Z,use_quota=True,user_id='f0b1cfa394ed40d981746e24425293e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Creating volume 6c461e18-331d-424c-a8b7-cd116ac59bb5 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:44:45 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6c461e18-331d-424c-a8b7-cd116ac59bb5 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d4aa38-fb0d-48cd-990e-bf8d5e439c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb52e6d2-7975-402d-92c1-16640c2c5f98', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe02861a-9be5-4ca6-b5e9-0dcb86e6b647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:45 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6c461e18-331d-424c-a8b7-cd116ac59bb5 1073741824 Aug 05 10:44:45 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:45 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Volume volume-63e05493-7826-451f-8dc3-2a298514f4c2 (63e05493-7826-451f-8dc3-2a298514f4c2): created successfully Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09dbbe67-3e03-46bc-9786-306be3b96708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Flow 'volume_create_manager' (90ca4449-d9dd-4035-acdb-ce788cf25ff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:46 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume volume-cb52e6d2-7975-402d-92c1-16640c2c5f98 (cb52e6d2-7975-402d-92c1-16640c2c5f98): created successfully Aug 05 10:44:46 devstack sudo[109097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:44:46 devstack sudo[109097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe02861a-9be5-4ca6-b5e9-0dcb86e6b647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Flow 'volume_create_manager' (8654cbd0-d99b-4928-a787-ada47a33e114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:46 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-3ff721a6-7298-4038-ab27-d50289c76e2a tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Created volume successfully. Aug 05 10:44:46 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-6c22e722-346e-4d18-8e39-d3db986ea24a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Created volume successfully. Aug 05 10:44:46 devstack sudo[109097]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.262s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:44:46 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] Deleted volume successfully. Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-09e81a6f-acb0-478a-b8f4-48e2768730f8 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-ddd17b4c-8a5d-4705-81a8-be8de7a3e379-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Acquiring lock "cinder-63e05493-7826-451f-8dc3-2a298514f4c2-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:46 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6c461e18-331d-424c-a8b7-cd116ac59bb5 1073741824" returned: 0 in 0.502s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Lock "cinder-63e05493-7826-451f-8dc3-2a298514f4c2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Acquiring lock "cinder-quobyte-63e05493-7826-451f-8dc3-2a298514f4c2" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6c461e18-331d-424c-a8b7-cd116ac59bb5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:46 devstack sudo[109104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6c461e18-331d-424c-a8b7-cd116ac59bb5 Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Lock "cinder-quobyte-63e05493-7826-451f-8dc3-2a298514f4c2" acquired by "delete_volume" :: waited 0.032s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:46 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9542b8f9-2fd8-41f3-ab6c-076bc4f6169a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:46 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2 Aug 05 10:44:46 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:46 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6c461e18-331d-424c-a8b7-cd116ac59bb5" returned: 0 in 0.266s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.298s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1797455232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15ac94a-c999-40f7-b9ce-ff4719f9f8fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257331b239c64c398530524958798263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:43Z,use_quota=True,user_id='f0b1cfa394ed40d981746e24425293e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Creating volume c15ac94a-c999-40f7-b9ce-ff4719f9f8fa {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:44:46 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:46 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa 1073741824 Aug 05 10:44:46 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6783dd01-a638-4332-bf9e-12bf5ccc977b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c461e18-331d-424c-a8b7-cd116ac59bb5', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2363de4e-2436-4f80-b58d-b42d29f867c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:46 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume volume-6c461e18-331d-424c-a8b7-cd116ac59bb5 (6c461e18-331d-424c-a8b7-cd116ac59bb5): created successfully Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2363de4e-2436-4f80-b58d-b42d29f867c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Flow 'volume_create_manager' (3a6723c7-de04-4bb4-89dd-9c80176914ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "cinder-8bff8d55-0fbc-48f3-9396-936e58258078-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:46 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-cabbabc9-1853-49aa-a95c-8505ea7c6949 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Created volume successfully. Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-8bff8d55-0fbc-48f3-9396-936e58258078-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "cinder-quobyte-8bff8d55-0fbc-48f3-9396-936e58258078" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-quobyte-8bff8d55-0fbc-48f3-9396-936e58258078" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:46 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2" returned: 0 in 0.448s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb51d02-d24e-44bf-b410-fb519bb65be9]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8bff8d55-0fbc-48f3-9396-936e58258078 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:47 devstack sudo[109114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2 Aug 05 10:44:47 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:47 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8bff8d55-0fbc-48f3-9396-936e58258078 Aug 05 10:44:47 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:47 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-63e05493-7826-451f-8dc3-2a298514f4c2" returned: 0 in 0.289s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Lock "cinder-quobyte-63e05493-7826-451f-8dc3-2a298514f4c2" released by "delete_volume" :: held 0.785s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Created reservations ['95c9ef1f-634c-4fc3-b632-dd3252151336', '76528219-658b-4696-91ce-084f961b6b06', '0a8fb473-b994-4fe8-8d46-d5d2c5e62654', '87f60dfc-713d-4dc8-ad11-a299f01f43ec'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:44:47 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa 1073741824" returned: 0 in 0.625s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:47 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:47 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:47 devstack sudo[109128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:44:47 devstack sudo[109128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:47 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8bff8d55-0fbc-48f3-9396-936e58258078" returned: 0 in 0.555s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8bff8d55-0fbc-48f3-9396-936e58258078 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:47 devstack sudo[109130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8bff8d55-0fbc-48f3-9396-936e58258078 Aug 05 10:44:47 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:47 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa" returned: 0 in 0.336s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758f172f-9da5-4f0a-9957-e1cbfcb66589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da24ace9-ca31-4c86-af32-d7d6bd3f2d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:47 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Volume volume-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa (c15ac94a-c999-40f7-b9ce-ff4719f9f8fa): created successfully Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da24ace9-ca31-4c86-af32-d7d6bd3f2d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Flow 'volume_create_manager' (10a7918a-3ffe-44dc-9372-566f99010459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:47 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c070b1e4-f70e-43b1-9e93-ba9c8aec9ca7 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Created volume successfully. Aug 05 10:44:47 devstack sudo[109128]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.409s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:44:47 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Deleted volume successfully. Aug 05 10:44:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-c47cde22-e7be-48c7-83a3-e47145cebcef tempest-VolumeAndVolumeTypeFromImageTest-7842886 None] Lock "cinder-63e05493-7826-451f-8dc3-2a298514f4c2-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:48 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8bff8d55-0fbc-48f3-9396-936e58258078" returned: 0 in 0.481s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-quobyte-8bff8d55-0fbc-48f3-9396-936e58258078" released by "delete_volume" :: held 1.099s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:48 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] Created reservations ['0f49a00e-4c71-42b2-8762-1abf5ab45bf8', 'a8db92e0-cd1f-4da4-85a5-3f70d804b121', 'd0dbac73-7a1d-4208-8a66-44c0712950cf', '52d4aaaa-5d45-40b3-a9f3-9e2fa77706c7'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:44:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:48 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:44:48 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:48 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.253s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:48 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:44:48 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] Deleted volume successfully. Aug 05 10:44:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d99752d9-b68c-4357-8f4e-c72f1dd55af9 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-8bff8d55-0fbc-48f3-9396-936e58258078-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "cinder-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "cinder-quobyte-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-quobyte-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa" acquired by "delete_volume" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:49 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba44ff3-6bc1-4882-a512-7e5873592551]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "cinder-09d6f7d5-f201-41af-a70b-b8e34d031c4c-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:49 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa Aug 05 10:44:49 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-09d6f7d5-f201-41af-a70b-b8e34d031c4c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "cinder-quobyte-09d6f7d5-f201-41af-a70b-b8e34d031c4c" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-quobyte-09d6f7d5-f201-41af-a70b-b8e34d031c4c" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:49 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8749c72e-c76c-43d0-9645-28abc9bf3448]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-09d6f7d5-f201-41af-a70b-b8e34d031c4c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:49 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-09d6f7d5-f201-41af-a70b-b8e34d031c4c Aug 05 10:44:49 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:49 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa" returned: 0 in 0.464s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:49 devstack sudo[109145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa Aug 05 10:44:49 devstack sudo[109145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:49 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-09d6f7d5-f201-41af-a70b-b8e34d031c4c" returned: 0 in 0.460s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-09d6f7d5-f201-41af-a70b-b8e34d031c4c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:49 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-09d6f7d5-f201-41af-a70b-b8e34d031c4c Aug 05 10:44:49 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:49 devstack sudo[109145]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa" returned: 0 in 0.342s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-quobyte-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa" released by "delete_volume" :: held 0.879s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Created reservations ['c4734b81-7a11-4a6c-b413-c87e42a81b24', '92c7ebf2-e8a5-4641-a514-bc2388dceba0', 'bd95509d-4021-49d8-9ecb-de42817d4bf9', 'de15c477-92ce-4172-af4c-e53a03d282a1'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:50 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:44:50 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:50 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-09d6f7d5-f201-41af-a70b-b8e34d031c4c" returned: 0 in 0.347s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "cinder-6c461e18-331d-424c-a8b7-cd116ac59bb5-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-quobyte-09d6f7d5-f201-41af-a70b-b8e34d031c4c" released by "delete_volume" :: held 0.895s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-6c461e18-331d-424c-a8b7-cd116ac59bb5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "cinder-quobyte-6c461e18-331d-424c-a8b7-cd116ac59bb5" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-quobyte-6c461e18-331d-424c-a8b7-cd116ac59bb5" acquired by "delete_volume" :: waited 0.056s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a3fcb4-92c2-46da-941b-cd225a7a5a65]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6c461e18-331d-424c-a8b7-cd116ac59bb5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] Created reservations ['985d478b-9b8d-4c26-8611-5fa2c50a92d7', '63c12784-ee13-4042-b4d2-b27e78da593f', 'c036dca3-892d-4cb5-af69-7e54efd0618d', '89b1c8eb-6893-4144-9c43-9d86fcd156f2'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:44:50 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.378s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:44:50 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Deleted volume successfully. Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-acadb92c-e06d-4a27-9fb5-4d6b2b683c8a tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-c15ac94a-c999-40f7-b9ce-ff4719f9f8fa-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:50 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6c461e18-331d-424c-a8b7-cd116ac59bb5 Aug 05 10:44:50 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:50 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:44:50 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:50 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.279s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:44:50 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] Deleted volume successfully. Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-250fc6f8-37b6-43c9-8687-37b02ba9279f tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-09d6f7d5-f201-41af-a70b-b8e34d031c4c-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:50 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6c461e18-331d-424c-a8b7-cd116ac59bb5" returned: 0 in 0.502s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6c461e18-331d-424c-a8b7-cd116ac59bb5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:51 devstack sudo[109166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6c461e18-331d-424c-a8b7-cd116ac59bb5 Aug 05 10:44:51 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:51 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6c461e18-331d-424c-a8b7-cd116ac59bb5" returned: 0 in 0.315s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-quobyte-6c461e18-331d-424c-a8b7-cd116ac59bb5" released by "delete_volume" :: held 0.882s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Created reservations ['d801904b-37a7-493b-8f1b-2d3cd033d81e', '0f6198db-54bf-410b-895b-8bfd29437fbd', 'c0878ec2-daf7-48a4-92ff-025b08950bac', '5816b769-9e9f-4a56-943d-de1204801211'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:51 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:44:51 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "cinder-36782676-367a-4ff6-9b76-72271027d8ab-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-36782676-367a-4ff6-9b76-72271027d8ab-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "cinder-quobyte-36782676-367a-4ff6-9b76-72271027d8ab" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-quobyte-36782676-367a-4ff6-9b76-72271027d8ab" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbee5c0-d7b1-4271-b8c6-d8ae6072ac9b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-36782676-367a-4ff6-9b76-72271027d8ab {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:51 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.306s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:44:51 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Deleted volume successfully. Aug 05 10:44:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-837e7155-3ce4-4c17-94fe-4dc515b74ec3 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-6c461e18-331d-424c-a8b7-cd116ac59bb5-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:51 devstack sudo[109171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-36782676-367a-4ff6-9b76-72271027d8ab Aug 05 10:44:51 devstack sudo[109171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:52 devstack sudo[109171]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-36782676-367a-4ff6-9b76-72271027d8ab" returned: 0 in 0.431s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-36782676-367a-4ff6-9b76-72271027d8ab {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:52 devstack sudo[109177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-36782676-367a-4ff6-9b76-72271027d8ab Aug 05 10:44:52 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:52 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-36782676-367a-4ff6-9b76-72271027d8ab" returned: 0 in 0.292s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-quobyte-36782676-367a-4ff6-9b76-72271027d8ab" released by "delete_volume" :: held 0.787s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "cinder-cb52e6d2-7975-402d-92c1-16640c2c5f98-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:52 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] Created reservations ['74f3c19f-3b88-46e7-a32e-246ad26e62a6', '3ec0d9e1-bb46-414f-9a8f-6aba158501f1', '41001f31-612a-42d9-81ff-245d1a152468', '120cd12a-fc16-40e7-899c-acc5eb680359'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:44:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-cb52e6d2-7975-402d-92c1-16640c2c5f98-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "cinder-quobyte-cb52e6d2-7975-402d-92c1-16640c2c5f98" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:52 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-quobyte-cb52e6d2-7975-402d-92c1-16640c2c5f98" acquired by "delete_volume" :: waited 0.026s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:52 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76f5f2b-fc96-4465-8202-de03d84e0072]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cb52e6d2-7975-402d-92c1-16640c2c5f98 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:52 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:44:52 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:52 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cb52e6d2-7975-402d-92c1-16640c2c5f98 Aug 05 10:44:52 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:53 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cb52e6d2-7975-402d-92c1-16640c2c5f98" returned: 0 in 0.420s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cb52e6d2-7975-402d-92c1-16640c2c5f98 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:53 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.424s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:44:53 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] Deleted volume successfully. Aug 05 10:44:53 devstack sudo[109188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cb52e6d2-7975-402d-92c1-16640c2c5f98 Aug 05 10:44:53 devstack sudo[109188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-20372cdb-3e26-4638-8eaf-899708980e50 tempest-CreateVolumesFromImageTest-1675288603 None] Lock "cinder-36782676-367a-4ff6-9b76-72271027d8ab-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:53 devstack sudo[109188]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-cb52e6d2-7975-402d-92c1-16640c2c5f98" returned: 0 in 0.392s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-quobyte-cb52e6d2-7975-402d-92c1-16640c2c5f98" released by "delete_volume" :: held 0.878s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Flow 'volume_create_manager' (195100f0-1b82-412d-b0e8-ba922ad57fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3fff09-bd6c-42b3-a356-1707aa8ef88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3fff09-bd6c-42b3-a356-1707aa8ef88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1076581727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e997849a-a252-4e38-a54a-1e64ba44ea21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c91957dd88422f8f8cbbd7f08a0996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:54Z,use_quota=True,user_id='bc3b707f41b94ed094dbaaadea2e71cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de3423c-70cb-48e2-90ab-2e55bb5f9bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de3423c-70cb-48e2-90ab-2e55bb5f9bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b8c3ad-879b-47eb-a15e-5d97643a6d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b8c3ad-879b-47eb-a15e-5d97643a6d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e997849a-a252-4e38-a54a-1e64ba44ea21', 'volume_name': 'volume-e997849a-a252-4e38-a54a-1e64ba44ea21', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e29b6b-74a7-4e48-ba96-cbb55f0e4a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e29b6b-74a7-4e48-ba96-cbb55f0e4a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e6c127-b638-4d30-b3b4-71af31c692e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:53 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume e997849a-a252-4e38-a54a-1e64ba44ea21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e997849a-a252-4e38-a54a-1e64ba44ea21', 'volume_size': 1} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1076581727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e997849a-a252-4e38-a54a-1e64ba44ea21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c91957dd88422f8f8cbbd7f08a0996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:54Z,use_quota=True,user_id='bc3b707f41b94ed094dbaaadea2e71cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Creating volume e997849a-a252-4e38-a54a-1e64ba44ea21 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:44:53 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e997849a-a252-4e38-a54a-1e64ba44ea21 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Created reservations ['9cee2690-a0a7-4806-864c-3897737f90c1', '34edbcc8-259f-401c-9bb1-85b430a5e83e', '04a07fb9-277b-4512-9831-8a020afa9e2e', '198d6b1c-037b-4c83-9e04-34cdea69b7dd'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:44:53 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e997849a-a252-4e38-a54a-1e64ba44ea21 1073741824 Aug 05 10:44:53 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:53 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:44:53 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:54 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.412s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:44:54 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Deleted volume successfully. Aug 05 10:44:54 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e997849a-a252-4e38-a54a-1e64ba44ea21 1073741824" returned: 0 in 0.573s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b858fdc4-d03f-4c60-9774-04e56ceb8c50 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-cb52e6d2-7975-402d-92c1-16640c2c5f98-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e997849a-a252-4e38-a54a-1e64ba44ea21 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:54 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e997849a-a252-4e38-a54a-1e64ba44ea21 Aug 05 10:44:54 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:54 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e997849a-a252-4e38-a54a-1e64ba44ea21" returned: 0 in 0.281s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e6c127-b638-4d30-b3b4-71af31c692e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e997849a-a252-4e38-a54a-1e64ba44ea21', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77c3355-413e-4479-80f8-1d283e3fba87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:54 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume volume-e997849a-a252-4e38-a54a-1e64ba44ea21 (e997849a-a252-4e38-a54a-1e64ba44ea21): created successfully Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77c3355-413e-4479-80f8-1d283e3fba87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Flow 'volume_create_manager' (195100f0-1b82-412d-b0e8-ba922ad57fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:54 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-53d9d9e8-2c38-4be7-a9da-d70657851994 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Created volume successfully. Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "cinder-2a1bb0db-7bfd-4462-af2f-727092f82c59-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-2a1bb0db-7bfd-4462-af2f-727092f82c59-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "cinder-quobyte-2a1bb0db-7bfd-4462-af2f-727092f82c59" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-quobyte-2a1bb0db-7bfd-4462-af2f-727092f82c59" acquired by "delete_volume" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[555e221b-244f-4f21-b175-dd791cb4c05e]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a1bb0db-7bfd-4462-af2f-727092f82c59 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:55 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a1bb0db-7bfd-4462-af2f-727092f82c59 Aug 05 10:44:55 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:55 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a1bb0db-7bfd-4462-af2f-727092f82c59" returned: 0 in 0.373s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a1bb0db-7bfd-4462-af2f-727092f82c59 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:55 devstack sudo[109208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a1bb0db-7bfd-4462-af2f-727092f82c59 Aug 05 10:44:55 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:55 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2a1bb0db-7bfd-4462-af2f-727092f82c59" returned: 0 in 0.247s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-quobyte-2a1bb0db-7bfd-4462-af2f-727092f82c59" released by "delete_volume" :: held 0.670s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:55 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Created reservations ['d23aa39b-63e5-4924-9ee4-26c364020e20', 'c384cc15-53f0-4654-b0fa-71d83171be1d', 'c4a3259e-fd5b-4b6e-9856-366ebe8c8f24', 'f21f2a74-94f9-4832-9a0a-e23fbe6bcb00'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:44:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:55 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:44:55 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:56 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.323s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:44:56 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Deleted volume successfully. Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8d74d137-b600-48c7-bcb6-b669e96deb77 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-2a1bb0db-7bfd-4462-af2f-727092f82c59-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "cinder-f69bb91d-d514-478c-acc6-625fa39b66ac-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-f69bb91d-d514-478c-acc6-625fa39b66ac-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Flow 'volume_create_manager' (00cedab7-9e51-4023-a093-2952ddd9d62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b968085a-a5c6-4d99-9aad-ab8457107428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b968085a-a5c6-4d99-9aad-ab8457107428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-72884200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0289d75-ecdb-4967-bcd4-3612b58acc21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c91957dd88422f8f8cbbd7f08a0996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:56Z,use_quota=True,user_id='bc3b707f41b94ed094dbaaadea2e71cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6557458-468b-440b-aa0a-86cc26383639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6557458-468b-440b-aa0a-86cc26383639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc417a7-1d62-40ee-9d75-9e06eb1b1e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc417a7-1d62-40ee-9d75-9e06eb1b1e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0289d75-ecdb-4967-bcd4-3612b58acc21', 'volume_name': 'volume-a0289d75-ecdb-4967-bcd4-3612b58acc21', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27b1b20-f81b-4989-83dc-c1f8a24de527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27b1b20-f81b-4989-83dc-c1f8a24de527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af9da9d-84cc-4362-8626-a6de8ea086ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:56 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume a0289d75-ecdb-4967-bcd4-3612b58acc21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0289d75-ecdb-4967-bcd4-3612b58acc21', 'volume_size': 1} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-72884200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0289d75-ecdb-4967-bcd4-3612b58acc21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c91957dd88422f8f8cbbd7f08a0996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:56Z,use_quota=True,user_id='bc3b707f41b94ed094dbaaadea2e71cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Creating volume a0289d75-ecdb-4967-bcd4-3612b58acc21 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:44:56 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a0289d75-ecdb-4967-bcd4-3612b58acc21 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:56 devstack sudo[109214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a0289d75-ecdb-4967-bcd4-3612b58acc21 1073741824 Aug 05 10:44:56 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "cinder-quobyte-f69bb91d-d514-478c-acc6-625fa39b66ac" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-quobyte-f69bb91d-d514-478c-acc6-625fa39b66ac" acquired by "delete_volume" :: waited 0.033s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1667301e-a800-4273-94c9-1f4b21a0e3c1]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f69bb91d-d514-478c-acc6-625fa39b66ac {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Flow 'volume_create_manager' (9afba2fc-dfba-4489-8520-e279a3652f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:56 devstack sudo[109216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f69bb91d-d514-478c-acc6-625fa39b66ac Aug 05 10:44:56 devstack sudo[109216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebe738b-6b68-4238-b8c4-e53635dcefda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebe738b-6b68-4238-b8c4-e53635dcefda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2066296586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d72fd62-7ee1-47d3-b700-59caf1ccd82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c91957dd88422f8f8cbbd7f08a0996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:57Z,use_quota=True,user_id='bc3b707f41b94ed094dbaaadea2e71cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ecb395-4ee7-43e1-a882-956aa6c24380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ecb395-4ee7-43e1-a882-956aa6c24380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2f30c5-4a17-495f-8f3b-5ea2c6a80267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2f30c5-4a17-495f-8f3b-5ea2c6a80267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d72fd62-7ee1-47d3-b700-59caf1ccd82d', 'volume_name': 'volume-2d72fd62-7ee1-47d3-b700-59caf1ccd82d', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d124a80-2a53-4096-bd5f-9897651f5768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d124a80-2a53-4096-bd5f-9897651f5768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da9b747-7ca7-444e-a8d0-aaa0706d5196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:56 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume 2d72fd62-7ee1-47d3-b700-59caf1ccd82d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d72fd62-7ee1-47d3-b700-59caf1ccd82d', 'volume_size': 1} Aug 05 10:44:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:57 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a0289d75-ecdb-4967-bcd4-3612b58acc21 1073741824" returned: 0 in 0.720s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a0289d75-ecdb-4967-bcd4-3612b58acc21 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:57 devstack sudo[109216]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f69bb91d-d514-478c-acc6-625fa39b66ac" returned: 0 in 0.646s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f69bb91d-d514-478c-acc6-625fa39b66ac {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:57 devstack sudo[109224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a0289d75-ecdb-4967-bcd4-3612b58acc21 Aug 05 10:44:57 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:57 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f69bb91d-d514-478c-acc6-625fa39b66ac Aug 05 10:44:57 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Flow 'volume_create_manager' (dc4453b0-8814-4200-8c96-b3235567d5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef43187-c8f1-42d4-9b78-d6a67fc8e952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef43187-c8f1-42d4-9b78-d6a67fc8e952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-944844093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061e56fc-2ff3-4faa-827a-347366553b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c91957dd88422f8f8cbbd7f08a0996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:57Z,use_quota=True,user_id='bc3b707f41b94ed094dbaaadea2e71cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0838aa7-3197-4427-8c6b-9c76233def84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0838aa7-3197-4427-8c6b-9c76233def84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde9cf03-f8a7-43ac-a922-70d1683989b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde9cf03-f8a7-43ac-a922-70d1683989b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '061e56fc-2ff3-4faa-827a-347366553b9e', 'volume_name': 'volume-061e56fc-2ff3-4faa-827a-347366553b9e', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54326542-e86a-4ded-9a68-4e117d946247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54326542-e86a-4ded-9a68-4e117d946247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2642e2-65e0-4da6-9698-3f3fff057f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:57 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume 061e56fc-2ff3-4faa-827a-347366553b9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-061e56fc-2ff3-4faa-827a-347366553b9e', 'volume_size': 1} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:57 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a0289d75-ecdb-4967-bcd4-3612b58acc21" returned: 0 in 0.466s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.700s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2066296586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d72fd62-7ee1-47d3-b700-59caf1ccd82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c91957dd88422f8f8cbbd7f08a0996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:57Z,use_quota=True,user_id='bc3b707f41b94ed094dbaaadea2e71cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Creating volume 2d72fd62-7ee1-47d3-b700-59caf1ccd82d {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:57 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:44:57 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2d72fd62-7ee1-47d3-b700-59caf1ccd82d 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-f69bb91d-d514-478c-acc6-625fa39b66ac" returned: 0 in 0.488s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:57 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2d72fd62-7ee1-47d3-b700-59caf1ccd82d 1073741824 Aug 05 10:44:57 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af9da9d-84cc-4362-8626-a6de8ea086ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0289d75-ecdb-4967-bcd4-3612b58acc21', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b10cc0-b205-4303-bb22-9ddf10968e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-quobyte-f69bb91d-d514-478c-acc6-625fa39b66ac" released by "delete_volume" :: held 1.257s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:57 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume volume-a0289d75-ecdb-4967-bcd4-3612b58acc21 (a0289d75-ecdb-4967-bcd4-3612b58acc21): created successfully Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b10cc0-b205-4303-bb22-9ddf10968e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Flow 'volume_create_manager' (00cedab7-9e51-4023-a093-2952ddd9d62f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Flow 'volume_create_manager' (e322d8de-99bd-410b-80fa-a0d62acc8b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0bf62c-19bd-4142-ad63-7da116034fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:57 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-9969fecf-5577-4292-8f18-e2c65fff83ee tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Created volume successfully. Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0bf62c-19bd-4142-ad63-7da116034fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-720247990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea09c39-1d24-40b1-9870-6292a42b21f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c91957dd88422f8f8cbbd7f08a0996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:58Z,use_quota=True,user_id='bc3b707f41b94ed094dbaaadea2e71cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da73df91-d4bf-4660-92d5-5e2ddf515451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da73df91-d4bf-4660-92d5-5e2ddf515451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d668d2-d61a-486f-ae99-cdf8de84229e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d668d2-d61a-486f-ae99-cdf8de84229e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ea09c39-1d24-40b1-9870-6292a42b21f3', 'volume_name': 'volume-3ea09c39-1d24-40b1-9870-6292a42b21f3', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9b40ec-3008-4514-ade0-c0637a1727d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9b40ec-3008-4514-ade0-c0637a1727d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c62c82f-0db8-4890-bf09-98a20278dae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:57 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume 3ea09c39-1d24-40b1-9870-6292a42b21f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ea09c39-1d24-40b1-9870-6292a42b21f3', 'volume_size': 1} Aug 05 10:44:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Created reservations ['4abd4158-55ea-4f2b-82f8-6e58f92badc4', '72a64b84-c0f6-45f5-b685-5c59f1feac5d', 'a0fa5768-f407-4775-9a44-f812a0e1d07c', '4e289aac-ef32-497b-bbac-9b20f135d0ee'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:58 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:44:58 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:58 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2d72fd62-7ee1-47d3-b700-59caf1ccd82d 1073741824" returned: 0 in 0.731s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2d72fd62-7ee1-47d3-b700-59caf1ccd82d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:58 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:58 devstack sudo[109239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2d72fd62-7ee1-47d3-b700-59caf1ccd82d Aug 05 10:44:58 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Flow 'volume_create_manager' (64c09aca-24e7-4904-be95-4ff6e08b1e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e8ff5b-f820-40de-a379-095da72680ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.387s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:44:58 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Deleted volume successfully. Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e8ff5b-f820-40de-a379-095da72680ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1998980147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5303afe-8e68-48fd-a5cb-08aab7e4848d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c91957dd88422f8f8cbbd7f08a0996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:58Z,use_quota=True,user_id='bc3b707f41b94ed094dbaaadea2e71cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1a1493-ec98-418f-8644-14575e6e6f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1a1493-ec98-418f-8644-14575e6e6f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c24be2-5551-4985-bb3d-081d1dece69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c24be2-5551-4985-bb3d-081d1dece69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5303afe-8e68-48fd-a5cb-08aab7e4848d', 'volume_name': 'volume-b5303afe-8e68-48fd-a5cb-08aab7e4848d', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c096db74-a194-45bc-a796-50c80ca211e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c096db74-a194-45bc-a796-50c80ca211e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ff1ef4-27fc-4655-aded-5c7ff684981c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:58 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume b5303afe-8e68-48fd-a5cb-08aab7e4848d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5303afe-8e68-48fd-a5cb-08aab7e4848d', 'volume_size': 1} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ad432e83-309a-49f9-9f18-e9ca76171799 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-f69bb91d-d514-478c-acc6-625fa39b66ac-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:44:58 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2d72fd62-7ee1-47d3-b700-59caf1ccd82d" returned: 0 in 0.285s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.192s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-944844093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061e56fc-2ff3-4faa-827a-347366553b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c91957dd88422f8f8cbbd7f08a0996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:57Z,use_quota=True,user_id='bc3b707f41b94ed094dbaaadea2e71cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Creating volume 061e56fc-2ff3-4faa-827a-347366553b9e {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:44:58 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-061e56fc-2ff3-4faa-827a-347366553b9e 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da9b747-7ca7-444e-a8d0-aaa0706d5196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d72fd62-7ee1-47d3-b700-59caf1ccd82d', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:58 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-061e56fc-2ff3-4faa-827a-347366553b9e 1073741824 Aug 05 10:44:58 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee1159b-24bb-4870-a932-d753c0485665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:58 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume volume-2d72fd62-7ee1-47d3-b700-59caf1ccd82d (2d72fd62-7ee1-47d3-b700-59caf1ccd82d): created successfully Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee1159b-24bb-4870-a932-d753c0485665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Flow 'volume_create_manager' (9afba2fc-dfba-4489-8520-e279a3652f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:58 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d2e9b49d-9bf3-4f1b-ba6a-8fb0fc294851 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Created volume successfully. Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "cinder-8f4a8caf-ead4-4b98-a8fd-724aeb73e158-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-8f4a8caf-ead4-4b98-a8fd-724aeb73e158-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "cinder-quobyte-95bbc326-7cfa-4cb4-9e0b-fa80c439501c" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-quobyte-95bbc326-7cfa-4cb4-9e0b-fa80c439501c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "cinder-quobyte-8f4a8caf-ead4-4b98-a8fd-724aeb73e158" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-quobyte-8f4a8caf-ead4-4b98-a8fd-724aeb73e158" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Deleting offline snapshot 8f4a8caf-ead4-4b98-a8fd-724aeb73e158 of volume 95bbc326-7cfa-4cb4-9e0b-fa80c439501c {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] snapshot_file for this snap is: volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bffa63-9d4b-4301-8bde-f5b85b280cde]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:59 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-061e56fc-2ff3-4faa-827a-347366553b9e 1073741824" returned: 0 in 0.584s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-061e56fc-2ff3-4faa-827a-347366553b9e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:59 devstack sudo[109250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-061e56fc-2ff3-4faa-827a-347366553b9e Aug 05 10:44:59 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:59 devstack sudo[109249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158 Aug 05 10:44:59 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:59 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-061e56fc-2ff3-4faa-827a-347366553b9e" returned: 0 in 0.317s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.750s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-720247990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea09c39-1d24-40b1-9870-6292a42b21f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c91957dd88422f8f8cbbd7f08a0996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:58Z,use_quota=True,user_id='bc3b707f41b94ed094dbaaadea2e71cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Creating volume 3ea09c39-1d24-40b1-9870-6292a42b21f3 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:44:59 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3ea09c39-1d24-40b1-9870-6292a42b21f3 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:59 devstack sudo[109258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3ea09c39-1d24-40b1-9870-6292a42b21f3 1073741824 Aug 05 10:44:59 devstack sudo[109258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2642e2-65e0-4da6-9698-3f3fff057f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-061e56fc-2ff3-4faa-827a-347366553b9e', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37afdc2-90a4-450b-a9e1-4b90403cdb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:44:59 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158" returned: 0 in 0.510s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:44:59 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume volume-061e56fc-2ff3-4faa-827a-347366553b9e (061e56fc-2ff3-4faa-827a-347366553b9e): created successfully Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37afdc2-90a4-450b-a9e1-4b90403cdb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Flow 'volume_create_manager' (dc4453b0-8814-4200-8c96-b3235567d5d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4e1abc-9a23-4483-ab8d-1762755bb434]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:44:59 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-63f73e0c-5bd3-4a3a-bcce-6d562c210dfa tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Created volume successfully. Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:44:59 devstack sudo[109260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c Aug 05 10:44:59 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:44:59 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Flow 'volume_create_manager' (721aa26f-7063-4956-a47a-ae7a7b26b23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7524a59e-454d-4169-96ce-54c803434ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7524a59e-454d-4169-96ce-54c803434ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8252f29f-dd9a-47a1-bf4b-9349aea69783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8a41f9f29f4defbb119230e0826c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:00Z,use_quota=True,user_id='78012705d1974d2e8ae6dc722609d8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d742d5f-4cb2-4056-b7f5-9084264d147f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d742d5f-4cb2-4056-b7f5-9084264d147f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (589d5d24-ec26-47b7-83cf-0c53c22b36b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.image.glance [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Creating Keystone auth plugin from conf {{(pid=88736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 10:45:00 devstack sudo[109258]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3ea09c39-1d24-40b1-9870-6292a42b21f3 1073741824" returned: 0 in 0.562s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3ea09c39-1d24-40b1-9870-6292a42b21f3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:00 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c" returned: 0 in 0.501s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:00 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3ea09c39-1d24-40b1-9870-6292a42b21f3 Aug 05 10:45:00 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:00 devstack sudo[109271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158 Aug 05 10:45:00 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (589d5d24-ec26-47b7-83cf-0c53c22b36b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8252f29f-dd9a-47a1-bf4b-9349aea69783', 'volume_name': 'volume-8252f29f-dd9a-47a1-bf4b-9349aea69783', 'volume_size': 1, 'image_id': '6e22d399-08bf-4962-836c-7c919bba2ae3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e22d399-08bf-4962-836c-7c919bba2ae3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bd83ecba911580668321845920a54739', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef8a41f9f29f4defbb119230e0826c89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fc67312fe4e69888d6d3f68f14db65012a182dcf62c10fa2b84c755585a353ab2432cf220e11549a5d66ec9998eb6c1e35b2010ab08abf5555807a0c6f87ffca', 'id': '6e22d399-08bf-4962-836c-7c919bba2ae3', 'created_at': datetime.datetime(2026, 8, 5, 8, 44, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 44, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e22d399-08bf-4962-836c-7c919bba2ae3/file', 'properties': {}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8bad27-bf29-412a-9a40-15967bb5d37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8bad27-bf29-412a-9a40-15967bb5d37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d6556a-8a00-4145-951c-d0eeb5e1972d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:00 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Volume 8252f29f-dd9a-47a1-bf4b-9349aea69783: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8252f29f-dd9a-47a1-bf4b-9349aea69783', 'volume_size': 1, 'image_id': '6e22d399-08bf-4962-836c-7c919bba2ae3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e22d399-08bf-4962-836c-7c919bba2ae3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bd83ecba911580668321845920a54739', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef8a41f9f29f4defbb119230e0826c89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fc67312fe4e69888d6d3f68f14db65012a182dcf62c10fa2b84c755585a353ab2432cf220e11549a5d66ec9998eb6c1e35b2010ab08abf5555807a0c6f87ffca', 'id': '6e22d399-08bf-4962-836c-7c919bba2ae3', 'created_at': datetime.datetime(2026, 8, 5, 8, 44, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 44, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e22d399-08bf-4962-836c-7c919bba2ae3/file', 'properties': {}}, 'image_service': } Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Trying to clone 8252f29f-dd9a-47a1-bf4b-9349aea69783 from image 6e22d399-08bf-4962-836c-7c919bba2ae3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6e22d399-08bf-4962-836c-7c919bba2ae3', 'metadata': {}}]). {{(pid=88736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 10:45:00 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3ea09c39-1d24-40b1-9870-6292a42b21f3" returned: 0 in 0.338s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.088s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1998980147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5303afe-8e68-48fd-a5cb-08aab7e4848d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c91957dd88422f8f8cbbd7f08a0996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:44:58Z,use_quota=True,user_id='bc3b707f41b94ed094dbaaadea2e71cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Creating volume b5303afe-8e68-48fd-a5cb-08aab7e4848d {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:45:00 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5303afe-8e68-48fd-a5cb-08aab7e4848d 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 10:45:00 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Image download 0.00 MB at 0.00 MB/s Aug 05 10:45:00 devstack sudo[109277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5303afe-8e68-48fd-a5cb-08aab7e4848d 1073741824 Aug 05 10:45:00 devstack sudo[109277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c62c82f-0db8-4890-bf09-98a20278dae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ea09c39-1d24-40b1-9870-6292a42b21f3', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2ee437-eaa7-4f40-a009-5c3b002e12d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91ba4a5-ae46-4ecb-bc27-72d14702a76c]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:00 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume volume-3ea09c39-1d24-40b1-9870-6292a42b21f3 (3ea09c39-1d24-40b1-9870-6292a42b21f3): created successfully Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2ee437-eaa7-4f40-a009-5c3b002e12d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Flow 'volume_create_manager' (e322d8de-99bd-410b-80fa-a0d62acc8b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:00 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-861ddadd-e5d2-47f6-ba17-7fdd949d9b3f tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Created volume successfully. Aug 05 10:45:00 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158" returned: 0 in 0.520s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:00 devstack sudo[109281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158 Aug 05 10:45:00 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:00 devstack sudo[109280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD Aug 05 10:45:00 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:01 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c.8f4a8caf-ead4-4b98-a8fd-724aeb73e158" returned: 0 in 0.295s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:01 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:01 devstack sudo[109277]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5303afe-8e68-48fd-a5cb-08aab7e4848d 1073741824" returned: 0 in 0.573s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-quobyte-8f4a8caf-ead4-4b98-a8fd-724aeb73e158" released by "_delete_snapshot" :: held 2.041s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-quobyte-95bbc326-7cfa-4cb4-9e0b-fa80c439501c" released by "delete_snapshot" :: held 2.075s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5303afe-8e68-48fd-a5cb-08aab7e4848d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:01 devstack sudo[109291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD Aug 05 10:45:01 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:01 devstack sudo[109292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5303afe-8e68-48fd-a5cb-08aab7e4848d Aug 05 10:45:01 devstack sudo[109292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Created reservations ['a02b17fc-b101-4f0b-85b8-30963fd37083', '8b3f3f0d-057a-4275-ab92-d57bb3f4c0bd', '7f13e0b4-2f22-475c-81bf-329e0d0f1749', '6671e8b3-2229-4e61-9b82-f58461713c06'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:01 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Delete snapshot completed successfully. Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99d35655-bfb1-4d07-a5b2-3b4ee4324138 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-8f4a8caf-ead4-4b98-a8fd-724aeb73e158-delete_snapshot" released by "delete_snapshot" :: held 2.287s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:01 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD" returned: 1 in 0.438s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:45:01 devstack sudo[109292]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Temporary image 6e22d399-08bf-4962-836c-7c919bba2ae3 is fetched for user 78012705d1974d2e8ae6dc722609d8ec. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5303afe-8e68-48fd-a5cb-08aab7e4848d" returned: 0 in 0.315s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ff1ef4-27fc-4655-aded-5c7ff684981c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5303afe-8e68-48fd-a5cb-08aab7e4848d', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbea8e4b-97c6-43fe-9a60-4bb0378d8272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:01 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Volume volume-b5303afe-8e68-48fd-a5cb-08aab7e4848d (b5303afe-8e68-48fd-a5cb-08aab7e4848d): created successfully Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbea8e4b-97c6-43fe-9a60-4bb0378d8272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Flow 'volume_create_manager' (64c09aca-24e7-4904-be95-4ff6e08b1e19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:01 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-2c7ee367-9eb6-416e-a337-36d222b25ed6 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Created volume successfully. Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[55874dd1-1fd5-4930-adc8-d2b44d1a394b]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:01 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD Aug 05 10:45:01 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:02 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:02 devstack sudo[109306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD Aug 05 10:45:02 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:02 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8252f29f-dd9a-47a1-bf4b-9349aea69783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8a41f9f29f4defbb119230e0826c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:00Z,use_quota=True,user_id='78012705d1974d2e8ae6dc722609d8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Creating volume 8252f29f-dd9a-47a1-bf4b-9349aea69783 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:45:02 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "cinder-95bbc326-7cfa-4cb4-9e0b-fa80c439501c-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:02 devstack sudo[109311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783 1073741824 Aug 05 10:45:02 devstack sudo[109311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-95bbc326-7cfa-4cb4-9e0b-fa80c439501c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "cinder-quobyte-95bbc326-7cfa-4cb4-9e0b-fa80c439501c" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-quobyte-95bbc326-7cfa-4cb4-9e0b-fa80c439501c" acquired by "delete_volume" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[222a64bd-f302-43e9-90b1-963a2573cd33]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:02 devstack sudo[109313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c Aug 05 10:45:02 devstack sudo[109313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "cinder-b5303afe-8e68-48fd-a5cb-08aab7e4848d-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-b5303afe-8e68-48fd-a5cb-08aab7e4848d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "cinder-quobyte-b5303afe-8e68-48fd-a5cb-08aab7e4848d" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-quobyte-b5303afe-8e68-48fd-a5cb-08aab7e4848d" acquired by "delete_volume" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b410f7-0450-4fb6-bf6b-e5c6c7969a50]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5303afe-8e68-48fd-a5cb-08aab7e4848d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:02 devstack sudo[109311]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783 1073741824" returned: 0 in 0.587s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:03 devstack sudo[109313]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c" returned: 0 in 0.469s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:03 devstack sudo[109323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c Aug 05 10:45:03 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:03 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783 Aug 05 10:45:03 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:03 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5303afe-8e68-48fd-a5cb-08aab7e4848d Aug 05 10:45:03 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:03 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-95bbc326-7cfa-4cb4-9e0b-fa80c439501c" returned: 0 in 0.287s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:03 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-quobyte-95bbc326-7cfa-4cb4-9e0b-fa80c439501c" released by "delete_volume" :: held 0.815s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783" returned: 0 in 0.270s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Attempting download of 6e22d399-08bf-4962-836c-7c919bba2ae3 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e22d399-08bf-4962-836c-7c919bba2ae3', 'metadata': {}}])) to volume 8252f29f-dd9a-47a1-bf4b-9349aea69783. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Created reservations ['0f11d43a-19ce-419e-a3f2-5ec7b78fbeef', '7c40c266-eff0-4474-ba82-b58d0c3990aa', 'a9094e4f-3330-4962-b7a6-6c6e5f32fb4d', '32b3b45e-bcc3-4d9e-b701-1cba969e7670'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:03 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[565a6e94-4ca6-4bc5-9f03-5a6dc9d64f5d]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e22d399-08bf-4962-836c-7c919bba2ae3_3ok18kez {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5303afe-8e68-48fd-a5cb-08aab7e4848d" returned: 0 in 0.511s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5303afe-8e68-48fd-a5cb-08aab7e4848d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:03 devstack sudo[109335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5303afe-8e68-48fd-a5cb-08aab7e4848d Aug 05 10:45:03 devstack sudo[109335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:03 devstack sudo[109334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e22d399-08bf-4962-836c-7c919bba2ae3_3ok18kez Aug 05 10:45:03 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:03 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:03 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:03 devstack sudo[109335]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-b5303afe-8e68-48fd-a5cb-08aab7e4848d" returned: 0 in 0.382s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:03 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.317s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:03 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-quobyte-b5303afe-8e68-48fd-a5cb-08aab7e4848d" released by "delete_volume" :: held 0.967s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e22d399-08bf-4962-836c-7c919bba2ae3_3ok18kez" returned: 0 in 0.449s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:03 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Deleted volume successfully. Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e22d399-08bf-4962-836c-7c919bba2ae3_3ok18kez {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9fddc03e-faa9-4edf-a182-e1fba2ef3e98 tempest-CreateVolumesFromSnapshotTest-1619322295 None] Lock "cinder-95bbc326-7cfa-4cb4-9e0b-fa80c439501c-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:04 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Created reservations ['2b72183c-1fe0-43b0-aae8-7e7c8c3b52e5', '23c340b2-0243-46b4-8315-2b5c2ae2acf0', 'bb005ddc-8932-49bf-a456-0f91531b62f5', '38584859-c6e3-4767-bf27-cd7c91f0e875'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:04 devstack sudo[109344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e22d399-08bf-4962-836c-7c919bba2ae3_3ok18kez Aug 05 10:45:04 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:04 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:04 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:04 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e22d399-08bf-4962-836c-7c919bba2ae3_3ok18kez" returned: 1 in 0.511s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e22d399-08bf-4962-836c-7c919bba2ae3_3ok18kez' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:45:04 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a37bb55-c4eb-4e71-8d43-e3a022348581]: (4, 'raw') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:04 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.326s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:04 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:04 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Deleted volume successfully. Aug 05 10:45:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2339c4b6-3211-4a53-a6e2-3fbb07c1fa22 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-b5303afe-8e68-48fd-a5cb-08aab7e4848d-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:04 devstack sudo[109350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD Aug 05 10:45:04 devstack sudo[109350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:04 devstack sudo[109350]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:04 devstack sudo[109355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD Aug 05 10:45:04 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:05 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 10:45:05 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] 6e22d399-08bf-4962-836c-7c919bba2ae3 was raw, converting to qcow2 {{(pid=88736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 10:45:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "cinder-3ea09c39-1d24-40b1-9870-6292a42b21f3-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:05 devstack sudo[109360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783 Aug 05 10:45:05 devstack sudo[109360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-3ea09c39-1d24-40b1-9870-6292a42b21f3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "cinder-quobyte-3ea09c39-1d24-40b1-9870-6292a42b21f3" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-quobyte-3ea09c39-1d24-40b1-9870-6292a42b21f3" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:05 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d978e14f-7367-45c0-ab25-78416b338e4e]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3ea09c39-1d24-40b1-9870-6292a42b21f3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:05 devstack sudo[109362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3ea09c39-1d24-40b1-9870-6292a42b21f3 Aug 05 10:45:05 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:05 devstack sudo[109360]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783" returned: 0 in 0.612s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:05 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6e22d399-08bf-4962-836c-7c919bba2ae3_bhpctwbmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783 {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:45:05 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 10:45:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:05 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3ea09c39-1d24-40b1-9870-6292a42b21f3" returned: 0 in 0.456s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3ea09c39-1d24-40b1-9870-6292a42b21f3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:05 devstack sudo[109371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783 1G Aug 05 10:45:05 devstack sudo[109371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:05 devstack sudo[109372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3ea09c39-1d24-40b1-9870-6292a42b21f3 Aug 05 10:45:05 devstack sudo[109372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:06 devstack sudo[109372]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-3ea09c39-1d24-40b1-9870-6292a42b21f3" returned: 0 in 0.334s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-quobyte-3ea09c39-1d24-40b1-9870-6292a42b21f3" released by "delete_volume" :: held 0.849s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:06 devstack sudo[109371]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783 1G" returned: 0 in 0.411s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Downloaded image 6e22d399-08bf-4962-836c-7c919bba2ae3 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e22d399-08bf-4962-836c-7c919bba2ae3', 'metadata': {}}])) to volume 8252f29f-dd9a-47a1-bf4b-9349aea69783 successfully. {{(pid=88736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Temporary image 6e22d399-08bf-4962-836c-7c919bba2ae3 for user 78012705d1974d2e8ae6dc722609d8ec is deleted. {{(pid=88736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.volume.volume_utils [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Marking volume 8252f29f-dd9a-47a1-bf4b-9349aea69783 as bootable. {{(pid=88736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Copying metadata from image 6e22d399-08bf-4962-836c-7c919bba2ae3 to 8252f29f-dd9a-47a1-bf4b-9349aea69783. {{(pid=88736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Creating volume glance metadata for volume 8252f29f-dd9a-47a1-bf4b-9349aea69783 backed by image 6e22d399-08bf-4962-836c-7c919bba2ae3 with: {'image_id': '6e22d399-08bf-4962-836c-7c919bba2ae3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'bd83ecba911580668321845920a54739', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Created reservations ['7316301e-0e71-40a2-82c8-a55315539004', '0c9f5ca6-9628-4827-8510-6efcab56c91e', '96fbbd2f-6b8a-46c8-9593-f8e8bc34ac18', 'd78e93f3-a95a-4504-a6d4-9503ca93419b'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d6556a-8a00-4145-951c-d0eeb5e1972d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8252f29f-dd9a-47a1-bf4b-9349aea69783', 'volume_size': 1, 'image_id': '6e22d399-08bf-4962-836c-7c919bba2ae3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e22d399-08bf-4962-836c-7c919bba2ae3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bd83ecba911580668321845920a54739', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef8a41f9f29f4defbb119230e0826c89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fc67312fe4e69888d6d3f68f14db65012a182dcf62c10fa2b84c755585a353ab2432cf220e11549a5d66ec9998eb6c1e35b2010ab08abf5555807a0c6f87ffca', 'id': '6e22d399-08bf-4962-836c-7c919bba2ae3', 'created_at': datetime.datetime(2026, 8, 5, 8, 44, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 8, 44, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e22d399-08bf-4962-836c-7c919bba2ae3/file', 'properties': {}}, 'image_service': }' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d66d852-6678-4d31-bfc0-cc93a1efa0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:06 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Volume volume-8252f29f-dd9a-47a1-bf4b-9349aea69783 (8252f29f-dd9a-47a1-bf4b-9349aea69783): created successfully Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d66d852-6678-4d31-bfc0-cc93a1efa0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Flow 'volume_create_manager' (721aa26f-7063-4956-a47a-ae7a7b26b23e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:06 devstack sudo[109380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:06 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:06 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ab229c55-06e9-4210-8405-bd84180016ad tempest-VolumeImageDependencyTests-1400426385 None] Created volume successfully. Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "cinder-061e56fc-2ff3-4faa-827a-347366553b9e-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-061e56fc-2ff3-4faa-827a-347366553b9e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "cinder-quobyte-061e56fc-2ff3-4faa-827a-347366553b9e" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-quobyte-061e56fc-2ff3-4faa-827a-347366553b9e" acquired by "delete_volume" :: waited 0.029s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4368aa-07c4-4de8-bce3-5c1f29274fdb]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-061e56fc-2ff3-4faa-827a-347366553b9e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:06 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.372s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:06 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Deleted volume successfully. Aug 05 10:45:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2319f8b5-82e8-4e2a-bca9-6a37474c81a9 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-3ea09c39-1d24-40b1-9870-6292a42b21f3-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:06 devstack sudo[109382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-061e56fc-2ff3-4faa-827a-347366553b9e Aug 05 10:45:06 devstack sudo[109382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:07 devstack sudo[109382]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-061e56fc-2ff3-4faa-827a-347366553b9e" returned: 0 in 0.479s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-061e56fc-2ff3-4faa-827a-347366553b9e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:07 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-061e56fc-2ff3-4faa-827a-347366553b9e Aug 05 10:45:07 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:07 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-061e56fc-2ff3-4faa-827a-347366553b9e" returned: 0 in 0.284s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-quobyte-061e56fc-2ff3-4faa-827a-347366553b9e" released by "delete_volume" :: held 0.832s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Created reservations ['366f726b-3f22-4df5-910a-b7f6ac97fbb1', '8702b899-ed67-44cf-845e-7b13a04ef98e', '8c7d9122-4cc2-4137-b5b0-8c8dc158bfc8', 'e397e673-1fba-4e02-b6cd-2f5417cc1ff0'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] Acquiring lock "cinder-8252f29f-dd9a-47a1-bf4b-9349aea69783-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:07 devstack sudo[109391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:07 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] Lock "cinder-8252f29f-dd9a-47a1-bf4b-9349aea69783-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] Acquiring lock "cinder-quobyte-8252f29f-dd9a-47a1-bf4b-9349aea69783" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] Lock "cinder-quobyte-8252f29f-dd9a-47a1-bf4b-9349aea69783" acquired by "delete_volume" :: waited 0.029s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ac15d3-1d87-406d-91bd-aa5780805028]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "cinder-2d72fd62-7ee1-47d3-b700-59caf1ccd82d-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-2d72fd62-7ee1-47d3-b700-59caf1ccd82d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Flow 'volume_create_manager' (19e8ce61-a076-4d13-a7b4-a7a9ac9de59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5ab20e-6c09-4d7a-9393-06b01d66f613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5ab20e-6c09-4d7a-9393-06b01d66f613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-140917977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d3b6b1-8e30-4efb-8eaa-b03bef3712a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903ca14c35704b17911896f82bdfa77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:08Z,use_quota=True,user_id='008c4bc4324a4f879242d3056b53c394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4692994c-f782-4b12-a91b-60cc59e7fff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4692994c-f782-4b12-a91b-60cc59e7fff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf60624a-ee45-448a-8ddd-01cd49cafa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf60624a-ee45-448a-8ddd-01cd49cafa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28d3b6b1-8e30-4efb-8eaa-b03bef3712a1', 'volume_name': 'volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f196527-74f8-4ddb-aa48-b1a4f7eedf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f196527-74f8-4ddb-aa48-b1a4f7eedf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e26586-1aa4-41ad-8a21-ac5403241b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:07 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Volume 28d3b6b1-8e30-4efb-8eaa-b03bef3712a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1', 'volume_size': 1} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-140917977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d3b6b1-8e30-4efb-8eaa-b03bef3712a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903ca14c35704b17911896f82bdfa77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:08Z,use_quota=True,user_id='008c4bc4324a4f879242d3056b53c394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Creating volume 28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:45:07 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:45:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:07 devstack sudo[109393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783 Aug 05 10:45:07 devstack sudo[109393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:08 devstack sudo[109394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 1073741824 Aug 05 10:45:08 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "cinder-quobyte-2d72fd62-7ee1-47d3-b700-59caf1ccd82d" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-quobyte-2d72fd62-7ee1-47d3-b700-59caf1ccd82d" acquired by "delete_volume" :: waited 0.027s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:08 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.507s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00e4731-4172-4a6f-a14b-ddec446ef957]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2d72fd62-7ee1-47d3-b700-59caf1ccd82d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:08 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Deleted volume successfully. Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-998a76a8-2141-41c2-b866-e764a7582b28 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-061e56fc-2ff3-4faa-827a-347366553b9e-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:08 devstack sudo[109398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2d72fd62-7ee1-47d3-b700-59caf1ccd82d Aug 05 10:45:08 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:08 devstack sudo[109393]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783" returned: 0 in 0.573s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:08 devstack sudo[109406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783 Aug 05 10:45:08 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:08 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 1073741824" returned: 0 in 0.545s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:08 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2d72fd62-7ee1-47d3-b700-59caf1ccd82d" returned: 0 in 0.502s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2d72fd62-7ee1-47d3-b700-59caf1ccd82d {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:08 devstack sudo[109413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 Aug 05 10:45:08 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:08 devstack sudo[109416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2d72fd62-7ee1-47d3-b700-59caf1ccd82d Aug 05 10:45:08 devstack sudo[109416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:08 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-8252f29f-dd9a-47a1-bf4b-9349aea69783" returned: 0 in 0.349s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] Lock "cinder-quobyte-8252f29f-dd9a-47a1-bf4b-9349aea69783" released by "delete_volume" :: held 0.990s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] Created reservations ['5a826bba-f511-4bcf-838a-2b2bf9ece6ad', 'bb933ab0-c770-4bff-8067-a47885b7bdd6', 'ac6edcee-9649-4626-bc2e-94905f341775', 'fb294a28-829a-4126-9a49-8131740feff1'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:08 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1" returned: 0 in 0.351s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:08 devstack sudo[109419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:08 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e26586-1aa4-41ad-8a21-ac5403241b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d03bb2a9-0888-451e-a20c-3b4250ba4c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:08 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Volume volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 (28d3b6b1-8e30-4efb-8eaa-b03bef3712a1): created successfully Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d03bb2a9-0888-451e-a20c-3b4250ba4c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Flow 'volume_create_manager' (19e8ce61-a076-4d13-a7b4-a7a9ac9de59d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:09 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a351ecc3-ac87-45a0-98ea-910114ef3f04 tempest-VolumeDependencyTests-1927519368 None] Created volume successfully. Aug 05 10:45:09 devstack sudo[109416]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-2d72fd62-7ee1-47d3-b700-59caf1ccd82d" returned: 0 in 0.412s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-quobyte-2d72fd62-7ee1-47d3-b700-59caf1ccd82d" released by "delete_volume" :: held 0.980s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:09 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Created reservations ['abb56aba-62a4-43ba-9419-723172d90b46', 'b93bad03-fad0-4560-ba32-32127eca4e03', '1323ce35-e457-4728-b0c6-888ad14e0018', '1c7cebb3-211f-494f-811c-27c1e88039ce'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:09 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.279s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:09 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:09 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] Deleted volume successfully. Aug 05 10:45:09 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:09 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-836431e7-eed4-4137-b36c-7f18af7a8218 tempest-VolumeImageDependencyTests-1400426385 None] Lock "cinder-8252f29f-dd9a-47a1-bf4b-9349aea69783-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:09 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.262s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:09 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:09 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Deleted volume successfully. Aug 05 10:45:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7995b364-ae84-4899-9a2e-ef4e79b91ad0 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-2d72fd62-7ee1-47d3-b700-59caf1ccd82d-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:10 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] Creating offline snapshot cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e of volume 28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:45:10 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f34bda9-5ca5-4001-9ac5-a476809cb382]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "cinder-a0289d75-ecdb-4967-bcd4-3612b58acc21-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-a0289d75-ecdb-4967-bcd4-3612b58acc21-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "cinder-quobyte-a0289d75-ecdb-4967-bcd4-3612b58acc21" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-quobyte-a0289d75-ecdb-4967-bcd4-3612b58acc21" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:10 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee93a145-fea3-4fd2-a9ac-192a327230db]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a0289d75-ecdb-4967-bcd4-3612b58acc21 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:10 devstack sudo[109427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 Aug 05 10:45:10 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:10 devstack sudo[109429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a0289d75-ecdb-4967-bcd4-3612b58acc21 Aug 05 10:45:10 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:10 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1" returned: 0 in 0.558s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:10 devstack sudo[109435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e 1G Aug 05 10:45:10 devstack sudo[109435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:10 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a0289d75-ecdb-4967-bcd4-3612b58acc21" returned: 0 in 0.543s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a0289d75-ecdb-4967-bcd4-3612b58acc21 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:10 devstack sudo[109440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a0289d75-ecdb-4967-bcd4-3612b58acc21 Aug 05 10:45:10 devstack sudo[109440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:11 devstack sudo[109440]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a0289d75-ecdb-4967-bcd4-3612b58acc21" returned: 0 in 0.338s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-quobyte-a0289d75-ecdb-4967-bcd4-3612b58acc21" released by "delete_volume" :: held 0.946s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Created reservations ['d4469c57-866d-4c88-b051-2824b64bf284', '51f27f3c-5492-417a-8b9d-0f555f2ded43', 'fb44d2e8-9a74-4acb-9dd1-8aa5aea50777', 'f44d9090-e3e1-40b3-9bc8-eda637575d6d'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:11 devstack sudo[109435]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e 1G" returned: 0 in 0.665s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:11 devstack sudo[109446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e Aug 05 10:45:11 devstack sudo[109446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:11 devstack sudo[109448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:11 devstack sudo[109448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "cinder-e997849a-a252-4e38-a54a-1e64ba44ea21-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-e997849a-a252-4e38-a54a-1e64ba44ea21-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "cinder-quobyte-e997849a-a252-4e38-a54a-1e64ba44ea21" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-quobyte-e997849a-a252-4e38-a54a-1e64ba44ea21" acquired by "delete_volume" :: waited 0.029s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0383ef59-1893-48be-be25-826ac9faf850]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e997849a-a252-4e38-a54a-1e64ba44ea21 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:11 devstack sudo[109446]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e" returned: 0 in 0.439s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:11 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e is being set with open permissions: ugo+rw Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:11 devstack sudo[109448]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.409s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:11 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Deleted volume successfully. Aug 05 10:45:11 devstack sudo[109455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e Aug 05 10:45:11 devstack sudo[109455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:11 devstack sudo[109453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e997849a-a252-4e38-a54a-1e64ba44ea21 Aug 05 10:45:11 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b61c2bce-2b76-40b5-b926-5c321cef5bce tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-a0289d75-ecdb-4967-bcd4-3612b58acc21-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:12 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e997849a-a252-4e38-a54a-1e64ba44ea21" returned: 0 in 0.527s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e997849a-a252-4e38-a54a-1e64ba44ea21 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:12 devstack sudo[109462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e997849a-a252-4e38-a54a-1e64ba44ea21 Aug 05 10:45:12 devstack sudo[109462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:12 devstack sudo[109455]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e" returned: 0 in 0.526s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:12 devstack sudo[109465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.info Aug 05 10:45:12 devstack sudo[109465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:12 devstack sudo[109462]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e997849a-a252-4e38-a54a-1e64ba44ea21" returned: 0 in 0.360s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-quobyte-e997849a-a252-4e38-a54a-1e64ba44ea21" released by "delete_volume" :: held 0.948s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:12 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Created reservations ['88a140a3-8c3d-451e-acf2-7399c0ecd4de', 'b6044f37-eced-4b4b-9141-007430337faa', 'c13f5360-de9f-44b0-868b-5307ba76af40', 'f1cb84aa-af0e-4d23-bb53-42934438ea7c'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:12 devstack sudo[109465]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.info" returned: 0 in 0.416s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:12 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.info is being set with open permissions: ugo+rw Aug 05 10:45:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:12 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:12 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:12 devstack sudo[109472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.info Aug 05 10:45:12 devstack sudo[109472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:13 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.268s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:13 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:13 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Deleted volume successfully. Aug 05 10:45:13 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-00ff07b6-94fe-402c-95dd-d7a2f8b25a47 tempest-CreateVolumesFromSourceVolumeTest-777448068 None] Lock "cinder-e997849a-a252-4e38-a54a-1e64ba44ea21-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:13 devstack sudo[109472]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.info" returned: 0 in 0.331s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.095s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:13 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8be3602b-d272-4c11-a9fa-854153367791 tempest-VolumeDependencyTests-1927519368 None] Create snapshot completed successfully Aug 05 10:45:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:45:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:13 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:13 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Flow 'volume_create_manager' (393f1256-24b7-4084-9e98-b0b7437103a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29bac197-487d-46be-a43a-5fe0ed84bba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29bac197-487d-46be-a43a-5fe0ed84bba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-80801143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8a31df-aab9-4b22-94cb-119fc592e0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903ca14c35704b17911896f82bdfa77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:14Z,use_quota=True,user_id='008c4bc4324a4f879242d3056b53c394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7af7509-d172-437b-95f1-549cfff311be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7af7509-d172-437b-95f1-549cfff311be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0557705a-7b34-413d-bf02-4ff045c4774d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0557705a-7b34-413d-bf02-4ff045c4774d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f8a31df-aab9-4b22-94cb-119fc592e0da', 'volume_name': 'volume-5f8a31df-aab9-4b22-94cb-119fc592e0da', 'volume_size': 1, 'snapshot_id': 'cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd33aa4a-2e9f-4e29-8698-c7c16f07711b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd33aa4a-2e9f-4e29-8698-c7c16f07711b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ca42ca-6269-4247-9227-2b11f422ec91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:14 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Volume 5f8a31df-aab9-4b22-94cb-119fc592e0da: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f8a31df-aab9-4b22-94cb-119fc592e0da', 'volume_size': 1, 'snapshot_id': 'cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e'} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Acquiring lock "cinder-quobyte-cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e-5f8a31df-aab9-4b22-94cb-119fc592e0da" by "_create_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-quobyte-cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e-5f8a31df-aab9-4b22-94cb-119fc592e0da" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Creating volume 5f8a31df-aab9-4b22-94cb-119fc592e0da from snapshot cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e {{(pid=88736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Acquiring lock "cinder-quobyte-5f8a31df-aab9-4b22-94cb-119fc592e0da" by "_copy_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-quobyte-5f8a31df-aab9-4b22-94cb-119fc592e0da" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] snapshot: cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e, volume: 5f8a31df-aab9-4b22-94cb-119fc592e0da, {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:45:14 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.494s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e92030d-2ac7-4dd0-b3cd-80b2596353f2]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:14 devstack sudo[109479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e Aug 05 10:45:14 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:14 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e" returned: 0 in 0.378s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddee0b6-6aff-4407-a8a7-232714395a55]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:14 devstack sudo[109485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 Aug 05 10:45:14 devstack sudo[109485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:15 devstack sudo[109485]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1" returned: 0 in 0.485s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] will copy from snapshot at /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:45:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Creating direct copy from snapshot {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:45:15 devstack cinder-volume[88736]: DEBUG cinder.utils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Path /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5f8a31df-aab9-4b22-94cb-119fc592e0da not found in is_blk_device check {{(pid=88736) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:45:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5f8a31df-aab9-4b22-94cb-119fc592e0da {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:15 devstack sudo[109490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5f8a31df-aab9-4b22-94cb-119fc592e0da Aug 05 10:45:15 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:21 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5f8a31df-aab9-4b22-94cb-119fc592e0da" returned: 0 in 6.182s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Image conversion details: src /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5f8a31df-aab9-4b22-94cb-119fc592e0da {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:45:21 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Converted 1024.00 MB image at 165.61 MB/s Aug 05 10:45:21 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5f8a31df-aab9-4b22-94cb-119fc592e0da is being set with open permissions: ugo+rw Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5f8a31df-aab9-4b22-94cb-119fc592e0da {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:21 devstack sudo[109504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5f8a31df-aab9-4b22-94cb-119fc592e0da Aug 05 10:45:21 devstack sudo[109504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Flow 'volume_create_manager' (3bc425aa-943f-49a6-a9e2-8b85a00f1bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c97971-fe68-4805-93cb-890c9c58a53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c97971-fe68-4805-93cb-890c9c58a53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3ee727-83b3-4e92-bfb9-afbc766e3823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50697526a4b41a9b2d9d5d17b816329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:22Z,use_quota=True,user_id='b9fd3acf8b844e9697a9d8fb94b02b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1b3bd1-4557-4a75-a5c4-2b05f47331f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1b3bd1-4557-4a75-a5c4-2b05f47331f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4085cc-4f67-45a4-9a14-82bf0df03304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4085cc-4f67-45a4-9a14-82bf0df03304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae3ee727-83b3-4e92-bfb9-afbc766e3823', 'volume_name': 'volume-ae3ee727-83b3-4e92-bfb9-afbc766e3823', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259be839-1792-4980-98e7-71d38a7e425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259be839-1792-4980-98e7-71d38a7e425a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef5e1f4-1fe6-4b7f-b646-fc4f921adfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:21 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Volume ae3ee727-83b3-4e92-bfb9-afbc766e3823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae3ee727-83b3-4e92-bfb9-afbc766e3823', 'volume_size': 1} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:21 devstack sudo[109504]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5f8a31df-aab9-4b22-94cb-119fc592e0da" returned: 0 in 0.293s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-quobyte-5f8a31df-aab9-4b22-94cb-119fc592e0da" released by "_copy_volume_from_snapshot" :: held 7.443s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-quobyte-cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e-5f8a31df-aab9-4b22-94cb-119fc592e0da" released by "_create_volume_from_snapshot" :: held 7.520s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.537s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.178s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3ee727-83b3-4e92-bfb9-afbc766e3823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50697526a4b41a9b2d9d5d17b816329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:22Z,use_quota=True,user_id='b9fd3acf8b844e9697a9d8fb94b02b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Creating volume ae3ee727-83b3-4e92-bfb9-afbc766e3823 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:45:21 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae3ee727-83b3-4e92-bfb9-afbc766e3823 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:21 devstack sudo[109507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae3ee727-83b3-4e92-bfb9-afbc766e3823 1073741824 Aug 05 10:45:21 devstack sudo[109507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ca42ca-6269-4247-9227-2b11f422ec91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f8a31df-aab9-4b22-94cb-119fc592e0da', 'volume_size': 1, 'snapshot_id': 'cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00025ac6-93ee-474e-9da6-b897b092c049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:21 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Volume volume-5f8a31df-aab9-4b22-94cb-119fc592e0da (5f8a31df-aab9-4b22-94cb-119fc592e0da): created successfully Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00025ac6-93ee-474e-9da6-b897b092c049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:21 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Flow 'volume_create_manager' (393f1256-24b7-4084-9e98-b0b7437103a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:22 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e2e8df11-0080-44ae-a76e-6dc5f6ca5428 tempest-VolumeDependencyTests-1927519368 None] Created volume successfully. Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] Acquiring lock "cinder-cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] Acquiring lock "cinder-quobyte-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-quobyte-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] Acquiring lock "cinder-quobyte-cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-quobyte-cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] Deleting offline snapshot cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e of volume 28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] snapshot_file for this snap is: volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef70134f-a47d-4a4f-824d-1df41c7279b8]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:22 devstack sudo[109507]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae3ee727-83b3-4e92-bfb9-afbc766e3823 1073741824" returned: 0 in 0.703s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:22 devstack sudo[109513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e Aug 05 10:45:22 devstack sudo[109513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae3ee727-83b3-4e92-bfb9-afbc766e3823 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:22 devstack sudo[109515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae3ee727-83b3-4e92-bfb9-afbc766e3823 Aug 05 10:45:22 devstack sudo[109515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:22 devstack sudo[109515]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae3ee727-83b3-4e92-bfb9-afbc766e3823" returned: 0 in 0.282s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:22 devstack sudo[109513]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef5e1f4-1fe6-4b7f-b646-fc4f921adfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae3ee727-83b3-4e92-bfb9-afbc766e3823', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7cc67f-1bf7-4a22-94db-c7ecb51d305e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e" returned: 0 in 0.482s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a411200d-c4c3-4471-a932-674706977d8e]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:23 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Volume volume-ae3ee727-83b3-4e92-bfb9-afbc766e3823 (ae3ee727-83b3-4e92-bfb9-afbc766e3823): created successfully Aug 05 10:45:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7cc67f-1bf7-4a22-94db-c7ecb51d305e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Flow 'volume_create_manager' (3bc425aa-943f-49a6-a9e2-8b85a00f1bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:23 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-13c59422-e58e-42d4-9164-43ca532ebfa7 tempest-CinderUnicodeTest-1212801471 None] Created volume successfully. Aug 05 10:45:23 devstack sudo[109522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 Aug 05 10:45:23 devstack sudo[109522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:23 devstack sudo[109522]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1" returned: 0 in 0.585s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:23 devstack sudo[109528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e Aug 05 10:45:23 devstack sudo[109528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:24 devstack sudo[109528]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e" returned: 0 in 0.525s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:24 devstack sudo[109535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e Aug 05 10:45:24 devstack sudo[109535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Flow 'volume_create_manager' (d2b2f74f-de8b-4e70-8f88-a6693f9da800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386655cb-945c-4673-80b7-a2406434a0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386655cb-945c-4673-80b7-a2406434a0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1236347014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f69a1f-3f3d-42b9-98e8-2005dfab870c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50697526a4b41a9b2d9d5d17b816329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:24Z,use_quota=True,user_id='b9fd3acf8b844e9697a9d8fb94b02b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5d0445-de9a-4915-8206-16c49b2a37c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5d0445-de9a-4915-8206-16c49b2a37c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f74025-fe6a-46c4-a4bb-487c5ebae87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f74025-fe6a-46c4-a4bb-487c5ebae87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f69a1f-3f3d-42b9-98e8-2005dfab870c', 'volume_name': 'volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e0ddef-90d5-4739-a2a6-a2fc6fcb389c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e0ddef-90d5-4739-a2a6-a2fc6fcb389c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e956391a-ea79-41f0-a6c8-ac7f68c8e136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:24 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Volume a8f69a1f-3f3d-42b9-98e8-2005dfab870c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c', 'volume_size': 1} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1236347014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f69a1f-3f3d-42b9-98e8-2005dfab870c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50697526a4b41a9b2d9d5d17b816329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:24Z,use_quota=True,user_id='b9fd3acf8b844e9697a9d8fb94b02b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Creating volume a8f69a1f-3f3d-42b9-98e8-2005dfab870c {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:24 devstack sudo[109535]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:45:24 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1.cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e" returned: 0 in 0.362s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:24 devstack sudo[109538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c 1073741824 Aug 05 10:45:24 devstack sudo[109538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-quobyte-cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e" released by "_delete_snapshot" :: held 2.120s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-quobyte-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1" released by "delete_snapshot" :: held 2.167s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] Created reservations ['cf7bd941-25c0-4f1b-ae2c-8655782ba185', '8f54b1ee-057f-44a0-8d7f-a2e83dac8e0b', 'efaecdef-f37e-49d9-9395-5c5463844314', 'b6d73dd3-e608-4057-8cf2-c9bdd51c73e0'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:24 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] Delete snapshot completed successfully. Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05a96503-9edd-4ece-b8e4-17a7f3c3134f tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-cc3f7d11-7cd3-4ab3-8cf5-f3bbff2f786e-delete_snapshot" released by "delete_snapshot" :: held 2.345s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:24 devstack sudo[109538]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c 1073741824" returned: 0 in 0.518s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:25 devstack sudo[109544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c Aug 05 10:45:25 devstack sudo[109544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:25 devstack sudo[109544]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c" returned: 0 in 0.424s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:45:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e956391a-ea79-41f0-a6c8-ac7f68c8e136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93dfb1ba-d72f-4df4-b1c3-ed089793c3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:25 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Volume volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c (a8f69a1f-3f3d-42b9-98e8-2005dfab870c): created successfully Aug 05 10:45:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93dfb1ba-d72f-4df4-b1c3-ed089793c3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Flow 'volume_create_manager' (d2b2f74f-de8b-4e70-8f88-a6693f9da800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:25 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7d2053c1-4341-4b72-b003-219941f3911a tempest-CinderUnicodeTest-1212801471 None] Created volume successfully. Aug 05 10:45:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] Acquiring lock "cinder-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] Acquiring lock "cinder-quobyte-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:25 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-quobyte-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:25 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee87842-569b-4ccf-8d81-35f30d39e434]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:25 devstack sudo[109547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 Aug 05 10:45:25 devstack sudo[109547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:26 devstack sudo[109547]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1" returned: 0 in 0.414s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:26 devstack sudo[109552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1 Aug 05 10:45:26 devstack sudo[109552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:26 devstack sudo[109552]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1" returned: 0 in 0.305s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-quobyte-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1" released by "delete_volume" :: held 0.813s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:26 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] Created reservations ['ac9023da-f0e6-45b8-a51b-00098863b1e2', 'f40e674d-49f3-4c1c-9529-2e55b71b108c', '30ddbfcf-3df9-4f1a-b05e-9cad29938d4c', '9fb1ae51-2609-4afb-aca6-df9897e3489f'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:26 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:26 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:26 devstack sudo[109555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:26 devstack sudo[109555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] Acquiring lock "cinder-5f8a31df-aab9-4b22-94cb-119fc592e0da-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-5f8a31df-aab9-4b22-94cb-119fc592e0da-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] Acquiring lock "cinder-quobyte-5f8a31df-aab9-4b22-94cb-119fc592e0da" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-quobyte-5f8a31df-aab9-4b22-94cb-119fc592e0da" acquired by "delete_volume" :: waited 0.033s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:27 devstack sudo[109555]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.399s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:27 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:27 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] Deleted volume successfully. Aug 05 10:45:27 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7da3393-70ba-4118-83ab-9804e1e262ff]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5f8a31df-aab9-4b22-94cb-119fc592e0da {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:27 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-b087c471-2051-4838-89a2-2282a04f37f1 tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-28d3b6b1-8e30-4efb-8eaa-b03bef3712a1-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:27 devstack sudo[109558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5f8a31df-aab9-4b22-94cb-119fc592e0da Aug 05 10:45:27 devstack sudo[109558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:27 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] Creating offline snapshot c6acd481-5603-4532-a601-9ad826565a1c of volume a8f69a1f-3f3d-42b9-98e8-2005dfab870c {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:45:27 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ba866f-ecde-49f5-b47f-464d2c6840fc]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:27 devstack sudo[109560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c Aug 05 10:45:27 devstack sudo[109560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:27 devstack sudo[109558]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5f8a31df-aab9-4b22-94cb-119fc592e0da" returned: 0 in 0.618s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5f8a31df-aab9-4b22-94cb-119fc592e0da {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:27 devstack sudo[109565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5f8a31df-aab9-4b22-94cb-119fc592e0da Aug 05 10:45:27 devstack sudo[109565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:28 devstack sudo[109565]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5f8a31df-aab9-4b22-94cb-119fc592e0da" returned: 0 in 0.326s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-quobyte-5f8a31df-aab9-4b22-94cb-119fc592e0da" released by "delete_volume" :: held 1.063s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:28 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] Created reservations ['4999298e-8e8b-455c-b3d4-1e32b0671ac7', '935a9163-4c2a-4732-9ec4-d671349600e2', 'd5c2e2e8-69b9-4dc2-853c-ea44eba5eb00', '38309dce-30c4-4882-8c1e-0beb8fc07500'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:28 devstack sudo[109560]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c" returned: 0 in 0.679s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:28 devstack sudo[109571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c 1G Aug 05 10:45:28 devstack sudo[109571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:28 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:28 devstack sudo[109573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:28 devstack sudo[109573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:28 devstack sudo[109573]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.354s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:28 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:28 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] Deleted volume successfully. Aug 05 10:45:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-adb2ed61-a44a-4531-b9bf-d1e67d80076d tempest-VolumeDependencyTests-1927519368 None] Lock "cinder-5f8a31df-aab9-4b22-94cb-119fc592e0da-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:28 devstack sudo[109571]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c 1G" returned: 0 in 0.598s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:28 devstack sudo[109582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c Aug 05 10:45:28 devstack sudo[109582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:29 devstack sudo[109582]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c" returned: 0 in 0.360s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:29 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c is being set with open permissions: ugo+rw Aug 05 10:45:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:29 devstack sudo[109587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c Aug 05 10:45:29 devstack sudo[109587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:29 devstack sudo[109587]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c" returned: 0 in 0.454s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:29 devstack sudo[109590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.info Aug 05 10:45:29 devstack sudo[109590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:30 devstack sudo[109590]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.info" returned: 0 in 0.341s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:30 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.info is being set with open permissions: ugo+rw Aug 05 10:45:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:30 devstack sudo[109593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.info Aug 05 10:45:30 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:30 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.info" returned: 0 in 0.327s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.901s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:30 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=197,cinder:UPDATE=231,cinder:INSERT=75,cinder:DELETE=28 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:45:30 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-79604494-f561-4bc1-b86f-65bb7e1f4188 tempest-CinderUnicodeTest-1212801471 None] Create snapshot completed successfully Aug 05 10:45:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] Acquiring lock "cinder-c6acd481-5603-4532-a601-9ad826565a1c-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] Lock "cinder-c6acd481-5603-4532-a601-9ad826565a1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] Acquiring lock "cinder-quobyte-a8f69a1f-3f3d-42b9-98e8-2005dfab870c" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] Lock "cinder-quobyte-a8f69a1f-3f3d-42b9-98e8-2005dfab870c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] Acquiring lock "cinder-quobyte-c6acd481-5603-4532-a601-9ad826565a1c" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:30 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] Lock "cinder-quobyte-c6acd481-5603-4532-a601-9ad826565a1c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] Deleting offline snapshot c6acd481-5603-4532-a601-9ad826565a1c of volume a8f69a1f-3f3d-42b9-98e8-2005dfab870c {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:45:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] snapshot_file for this snap is: volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:45:30 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[519078cd-0b2f-4cc7-a16b-82cb2ee8a63f]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:31 devstack sudo[109597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c Aug 05 10:45:31 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:31 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c" returned: 0 in 0.555s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:31 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:45:31 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a42369-0120-493a-97a9-d6b632284e36]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:31 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c Aug 05 10:45:31 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:31 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c" returned: 0 in 0.423s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:31 devstack sudo[109609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c Aug 05 10:45:31 devstack sudo[109609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:32 devstack sudo[109609]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c" returned: 0 in 0.400s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:32 devstack sudo[109615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c Aug 05 10:45:32 devstack sudo[109615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:32 devstack sudo[109615]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c.c6acd481-5603-4532-a601-9ad826565a1c" returned: 0 in 0.306s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] Lock "cinder-quobyte-c6acd481-5603-4532-a601-9ad826565a1c" released by "_delete_snapshot" :: held 1.828s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] Lock "cinder-quobyte-a8f69a1f-3f3d-42b9-98e8-2005dfab870c" released by "delete_snapshot" :: held 1.867s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:32 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:UPDATE=280,cinder:SELECT=175,cinder:INSERT=62,cinder:DELETE=19 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:45:32 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] Created reservations ['b0a79319-f478-4fd4-87cc-3ae75bb07e6c', '29bc55d2-8901-46a5-81b2-43661ccd26ff', '3758b7ce-7edb-48a4-b26b-8e8debeba86a', '105cc4bd-66e8-4e08-aafd-42fbdfcb43fa'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:32 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] Delete snapshot completed successfully. Aug 05 10:45:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-fe75d5a1-d17a-4770-b58e-3ec3d815597c tempest-CinderUnicodeTest-1212801471 None] Lock "cinder-c6acd481-5603-4532-a601-9ad826565a1c-delete_snapshot" released by "delete_snapshot" :: held 2.045s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] Acquiring lock "cinder-a8f69a1f-3f3d-42b9-98e8-2005dfab870c-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] Lock "cinder-a8f69a1f-3f3d-42b9-98e8-2005dfab870c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] Acquiring lock "cinder-quobyte-a8f69a1f-3f3d-42b9-98e8-2005dfab870c" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] Lock "cinder-quobyte-a8f69a1f-3f3d-42b9-98e8-2005dfab870c" acquired by "delete_volume" :: waited 0.030s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f855284-3950-4524-9c1e-b91201a2391b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:33 devstack sudo[109618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c Aug 05 10:45:33 devstack sudo[109618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:33 devstack sudo[109618]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c" returned: 0 in 0.581s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:33 devstack sudo[109625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c Aug 05 10:45:33 devstack sudo[109625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Flow 'volume_create_manager' (d2bb026b-c19d-4800-abcd-34ca1ef44401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e29a2f-704a-4075-895d-f63d715a54b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e29a2f-704a-4075-895d-f63d715a54b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-403098414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba480dd-ffb6-4b2f-8e33-ef200544790a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39c7ae78713a4c1fbcfe49fb1e9c3b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:34Z,use_quota=True,user_id='3fe3d4d32641470b886a48814d253e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885aef36-9e82-445c-b71f-ef1a6f655040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885aef36-9e82-445c-b71f-ef1a6f655040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28403346-eeb2-4cd2-b77e-b25996eddb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28403346-eeb2-4cd2-b77e-b25996eddb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba480dd-ffb6-4b2f-8e33-ef200544790a', 'volume_name': 'volume-bba480dd-ffb6-4b2f-8e33-ef200544790a', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898152bc-93b2-4c00-995f-207f37328ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898152bc-93b2-4c00-995f-207f37328ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07aa486-a369-4bce-ae83-e691ef2b1ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:33 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Volume bba480dd-ffb6-4b2f-8e33-ef200544790a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba480dd-ffb6-4b2f-8e33-ef200544790a', 'volume_size': 1} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-403098414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba480dd-ffb6-4b2f-8e33-ef200544790a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39c7ae78713a4c1fbcfe49fb1e9c3b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:34Z,use_quota=True,user_id='3fe3d4d32641470b886a48814d253e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Creating volume bba480dd-ffb6-4b2f-8e33-ef200544790a {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:45:33 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:45:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bba480dd-ffb6-4b2f-8e33-ef200544790a 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:34 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bba480dd-ffb6-4b2f-8e33-ef200544790a 1073741824 Aug 05 10:45:34 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:34 devstack sudo[109625]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a8f69a1f-3f3d-42b9-98e8-2005dfab870c" returned: 0 in 0.321s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] Lock "cinder-quobyte-a8f69a1f-3f3d-42b9-98e8-2005dfab870c" released by "delete_volume" :: held 1.018s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:34 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] Created reservations ['864c2347-932e-4ae5-b8e2-8bc8eaf9e246', '330dd924-30d2-447c-8f9a-15be74783d86', '100e036f-c6ea-4592-9463-026e0e9b589a', '9a340a54-4d76-4cdb-982f-95b12e983bf7'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:34 devstack sudo[109633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:34 devstack sudo[109633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:34 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bba480dd-ffb6-4b2f-8e33-ef200544790a 1073741824" returned: 0 in 0.704s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bba480dd-ffb6-4b2f-8e33-ef200544790a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:34 devstack sudo[109633]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.420s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:34 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:34 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] Deleted volume successfully. Aug 05 10:45:34 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bba480dd-ffb6-4b2f-8e33-ef200544790a Aug 05 10:45:34 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:34 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d454bf14-7845-45ed-95d3-085447843dfe tempest-CinderUnicodeTest-1212801471 None] Lock "cinder-a8f69a1f-3f3d-42b9-98e8-2005dfab870c-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:35 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bba480dd-ffb6-4b2f-8e33-ef200544790a" returned: 0 in 0.335s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07aa486-a369-4bce-ae83-e691ef2b1ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba480dd-ffb6-4b2f-8e33-ef200544790a', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7330d7b8-03a7-42bd-97d2-d624aabbafcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:35 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Volume volume-bba480dd-ffb6-4b2f-8e33-ef200544790a (bba480dd-ffb6-4b2f-8e33-ef200544790a): created successfully Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7330d7b8-03a7-42bd-97d2-d624aabbafcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Flow 'volume_create_manager' (d2bb026b-c19d-4800-abcd-34ca1ef44401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:35 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-832d8880-3b5f-42be-b5bb-866c14744532 tempest-ProjectReaderTests-54302117 None] Created volume successfully. Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Flow 'volume_create_manager' (66816410-05c4-4a91-9210-3272696ed72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d541a3-c336-4c75-a3dc-f3c7248063a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d541a3-c336-4c75-a3dc-f3c7248063a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1809465175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab438c55-c758-486c-acf3-28d332065e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b6b72465254f0ba50fcade3ef18a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:35Z,use_quota=True,user_id='6b7cd23726634c2ebad9f38a27db563b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bccf35e-29e3-49d1-ab51-514fa64c199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bccf35e-29e3-49d1-ab51-514fa64c199d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b25100-2834-4428-8db8-3e29fc813293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b25100-2834-4428-8db8-3e29fc813293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab438c55-c758-486c-acf3-28d332065e04', 'volume_name': 'volume-ab438c55-c758-486c-acf3-28d332065e04', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa5ef82-8984-4151-8afe-2faa9a211b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa5ef82-8984-4151-8afe-2faa9a211b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c817bd-0d0a-40fd-8279-306ddee2acc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:35 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Volume ab438c55-c758-486c-acf3-28d332065e04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab438c55-c758-486c-acf3-28d332065e04', 'volume_size': 1} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1809465175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab438c55-c758-486c-acf3-28d332065e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b6b72465254f0ba50fcade3ef18a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:35Z,use_quota=True,user_id='6b7cd23726634c2ebad9f38a27db563b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Creating volume ab438c55-c758-486c-acf3-28d332065e04 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:45:35 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:35 devstack sudo[109640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04 1073741824 Aug 05 10:45:35 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] Acquiring lock "cinder-ae3ee727-83b3-4e92-bfb9-afbc766e3823-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] Lock "cinder-ae3ee727-83b3-4e92-bfb9-afbc766e3823-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] Acquiring lock "cinder-quobyte-ae3ee727-83b3-4e92-bfb9-afbc766e3823" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] Lock "cinder-quobyte-ae3ee727-83b3-4e92-bfb9-afbc766e3823" acquired by "delete_volume" :: waited 0.014s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c977d335-49c3-4810-99ec-9ff92df20fd8]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae3ee727-83b3-4e92-bfb9-afbc766e3823 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:35 devstack sudo[109642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae3ee727-83b3-4e92-bfb9-afbc766e3823 Aug 05 10:45:35 devstack sudo[109642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:35 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04 1073741824" returned: 0 in 0.581s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:35 devstack sudo[109642]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae3ee727-83b3-4e92-bfb9-afbc766e3823" returned: 0 in 0.443s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae3ee727-83b3-4e92-bfb9-afbc766e3823 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:35 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae3ee727-83b3-4e92-bfb9-afbc766e3823 Aug 05 10:45:35 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:36 devstack sudo[109652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04 Aug 05 10:45:36 devstack sudo[109652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] Acquiring lock "cinder-bba480dd-ffb6-4b2f-8e33-ef200544790a-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] Lock "cinder-bba480dd-ffb6-4b2f-8e33-ef200544790a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:36 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:36 devstack sudo[109652]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ae3ee727-83b3-4e92-bfb9-afbc766e3823" returned: 0 in 0.421s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04" returned: 0 in 0.373s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] Lock "cinder-quobyte-ae3ee727-83b3-4e92-bfb9-afbc766e3823" released by "delete_volume" :: held 0.929s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c817bd-0d0a-40fd-8279-306ddee2acc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab438c55-c758-486c-acf3-28d332065e04', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cff19d-32e7-40dd-a459-7994c8039d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:36 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Volume volume-ab438c55-c758-486c-acf3-28d332065e04 (ab438c55-c758-486c-acf3-28d332065e04): created successfully Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cff19d-32e7-40dd-a459-7994c8039d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Flow 'volume_create_manager' (66816410-05c4-4a91-9210-3272696ed72b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] Acquiring lock "cinder-quobyte-bba480dd-ffb6-4b2f-8e33-ef200544790a" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:36 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-f2df6976-283f-4ba7-a1fa-7671254c036a tempest-ProjectReaderTests-1268733534 None] Created volume successfully. Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] Lock "cinder-quobyte-bba480dd-ffb6-4b2f-8e33-ef200544790a" acquired by "delete_volume" :: waited 0.041s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ea6dca-25c4-40da-b3cd-83aeb702e4cc]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bba480dd-ffb6-4b2f-8e33-ef200544790a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] Created reservations ['4c74e29a-b775-4583-a02c-86c495f47cc7', 'de781b5e-35ef-401f-86b5-99b0f6c00ab3', 'b00ba157-84b1-49da-bfd4-51c7e962508b', 'cc62d0ca-35c5-4076-a772-3c6ae89f1248'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:36 devstack sudo[109694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bba480dd-ffb6-4b2f-8e33-ef200544790a Aug 05 10:45:36 devstack sudo[109694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:36 devstack sudo[109695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:36 devstack sudo[109695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:36 devstack sudo[109695]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.258s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:36 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] Deleted volume successfully. Aug 05 10:45:36 devstack sudo[109694]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bba480dd-ffb6-4b2f-8e33-ef200544790a" returned: 0 in 0.386s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bba480dd-ffb6-4b2f-8e33-ef200544790a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-4a9df160-52c3-44ef-b9e9-40cc67ba67e8 tempest-CinderUnicodeTest-1212801471 None] Lock "cinder-ae3ee727-83b3-4e92-bfb9-afbc766e3823-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:36 devstack sudo[109702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bba480dd-ffb6-4b2f-8e33-ef200544790a Aug 05 10:45:36 devstack sudo[109702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:37 devstack sudo[109702]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-bba480dd-ffb6-4b2f-8e33-ef200544790a" returned: 0 in 0.304s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:37 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] Lock "cinder-quobyte-bba480dd-ffb6-4b2f-8e33-ef200544790a" released by "delete_volume" :: held 0.753s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:37 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] Created reservations ['b5566e74-8832-4ba7-8eb9-80d71b87fdc9', 'af044df6-80df-4927-b252-5c8c2b730101', '129acf65-0018-4c9d-a65d-072c4e8ba430', 'cf96744e-0c8d-4824-b845-36fd50e0c639'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:37 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:37 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:37 devstack sudo[109705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:37 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:37 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] Creating offline snapshot 9c406da0-8010-4ec7-849c-27d80de8739c of volume ab438c55-c758-486c-acf3-28d332065e04 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:45:37 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[752aa9d7-133c-49ac-9986-5bdb09f75c6d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:37 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.362s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:37 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:37 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] Deleted volume successfully. Aug 05 10:45:37 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d9f76848-96c3-490e-9385-aa1d48076f58 tempest-ProjectReaderTests-54302117 None] Lock "cinder-bba480dd-ffb6-4b2f-8e33-ef200544790a-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:37 devstack sudo[109708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04 Aug 05 10:45:37 devstack sudo[109708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:38 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:45:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Flow 'volume_create_manager' (846b92c5-7562-4092-b314-ac45fc44bbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:38 devstack sudo[109708]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0725e8a8-0f5c-41ea-913a-4e2fb5434f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04" returned: 0 in 0.539s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0725e8a8-0f5c-41ea-913a-4e2fb5434f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-408179425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1b53261-d9bf-4652-997a-6f545d984f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39c7ae78713a4c1fbcfe49fb1e9c3b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:38Z,use_quota=True,user_id='3fe3d4d32641470b886a48814d253e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8891a3e-8483-44bc-9786-fe9bc8ffe266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8891a3e-8483-44bc-9786-fe9bc8ffe266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:38 devstack sudo[109713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c 1G Aug 05 10:45:38 devstack sudo[109713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f574bb-4ed9-4b99-ac1c-996bb58fe1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f574bb-4ed9-4b99-ac1c-996bb58fe1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1b53261-d9bf-4652-997a-6f545d984f9c', 'volume_name': 'volume-e1b53261-d9bf-4652-997a-6f545d984f9c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385dd4c3-9782-4cd8-9467-fa68244a4f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385dd4c3-9782-4cd8-9467-fa68244a4f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:38 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9dc63fc-f54c-4f1c-bd46-339b1b81b87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:38 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Volume e1b53261-d9bf-4652-997a-6f545d984f9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1b53261-d9bf-4652-997a-6f545d984f9c', 'volume_size': 1} Aug 05 10:45:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:38 devstack sudo[109713]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c 1G" returned: 0 in 0.560s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab438c55-c758-486c-acf3-28d332065e04 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:38 devstack sudo[109719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab438c55-c758-486c-acf3-28d332065e04 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c Aug 05 10:45:38 devstack sudo[109719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:39 devstack sudo[109719]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab438c55-c758-486c-acf3-28d332065e04 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c" returned: 0 in 0.448s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:39 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c is being set with open permissions: ugo+rw Aug 05 10:45:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:39 devstack sudo[109724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c Aug 05 10:45:39 devstack sudo[109724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:39 devstack sudo[109724]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c" returned: 0 in 0.311s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:39 devstack sudo[109727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.info Aug 05 10:45:39 devstack sudo[109727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:39 devstack sudo[109727]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.info" returned: 0 in 0.346s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:40 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.info is being set with open permissions: ugo+rw Aug 05 10:45:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:40 devstack sudo[109730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.info Aug 05 10:45:40 devstack sudo[109730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:40 devstack sudo[109730]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.info" returned: 0 in 0.356s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.689s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.036s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-408179425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1b53261-d9bf-4652-997a-6f545d984f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39c7ae78713a4c1fbcfe49fb1e9c3b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:38Z,use_quota=True,user_id='3fe3d4d32641470b886a48814d253e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:45:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Creating volume e1b53261-d9bf-4652-997a-6f545d984f9c {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:45:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:45:40 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:45:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e1b53261-d9bf-4652-997a-6f545d984f9c 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:40 devstack sudo[109733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e1b53261-d9bf-4652-997a-6f545d984f9c 1073741824 Aug 05 10:45:40 devstack sudo[109733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:40 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a25916cb-2b81-4c88-bf94-32e389048023 tempest-ProjectReaderTests-1268733534 None] Create snapshot completed successfully Aug 05 10:45:41 devstack sudo[109733]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e1b53261-d9bf-4652-997a-6f545d984f9c 1073741824" returned: 0 in 0.675s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e1b53261-d9bf-4652-997a-6f545d984f9c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:41 devstack sudo[109740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e1b53261-d9bf-4652-997a-6f545d984f9c Aug 05 10:45:41 devstack sudo[109740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-9c406da0-8010-4ec7-849c-27d80de8739c-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-9c406da0-8010-4ec7-849c-27d80de8739c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-quobyte-ab438c55-c758-486c-acf3-28d332065e04" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-ab438c55-c758-486c-acf3-28d332065e04" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-quobyte-9c406da0-8010-4ec7-849c-27d80de8739c" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-9c406da0-8010-4ec7-849c-27d80de8739c" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] Deleting offline snapshot 9c406da0-8010-4ec7-849c-27d80de8739c of volume ab438c55-c758-486c-acf3-28d332065e04 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] snapshot_file for this snap is: volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49baa51-5eec-4ade-b8b7-9c29cbad80e2]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:41 devstack sudo[109740]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e1b53261-d9bf-4652-997a-6f545d984f9c" returned: 0 in 0.354s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9dc63fc-f54c-4f1c-bd46-339b1b81b87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1b53261-d9bf-4652-997a-6f545d984f9c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd438e4-12cf-4576-a950-84d911ebe119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:41 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Volume volume-e1b53261-d9bf-4652-997a-6f545d984f9c (e1b53261-d9bf-4652-997a-6f545d984f9c): created successfully Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd438e4-12cf-4576-a950-84d911ebe119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Flow 'volume_create_manager' (846b92c5-7562-4092-b314-ac45fc44bbe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:41 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-03b2996d-97db-42f0-ae9c-33b04758c6a3 tempest-ProjectReaderTests-54302117 None] Created volume successfully. Aug 05 10:45:41 devstack sudo[109743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c Aug 05 10:45:41 devstack sudo[109743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:41 devstack sudo[109743]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c" returned: 0 in 0.483s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab438c55-c758-486c-acf3-28d332065e04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c85aa08-3eb1-4cde-9a6d-0d7901a1af37]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:42 devstack sudo[109748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04 Aug 05 10:45:42 devstack sudo[109748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:42 devstack sudo[109748]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04" returned: 0 in 0.461s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:42 devstack sudo[109753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] Acquiring lock "cinder-e1b53261-d9bf-4652-997a-6f545d984f9c-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:42 devstack sudo[109753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (c39032be-3ac8-4cfc-b0e1-154439afd2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4277ee9-9c08-4b41-95ab-c04d164bec0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4277ee9-9c08-4b41-95ab-c04d164bec0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1958028679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ce35b3-5242-4fe4-bf62-94928d8b9606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:42Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b45014-e567-4919-b1ff-19ad3368779c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b45014-e567-4919-b1ff-19ad3368779c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba164a07-1416-4ab0-84e1-c329b3a90266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba164a07-1416-4ab0-84e1-c329b3a90266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ce35b3-5242-4fe4-bf62-94928d8b9606', 'volume_name': 'volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce8b70de-ba04-4d23-bea5-f9357b1c83f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce8b70de-ba04-4d23-bea5-f9357b1c83f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9ccba4-4734-439e-ac3a-38e9a2598076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:42 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Volume c8ce35b3-5242-4fe4-bf62-94928d8b9606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606', 'volume_size': 1} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1958028679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ce35b3-5242-4fe4-bf62-94928d8b9606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:42Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Creating volume c8ce35b3-5242-4fe4-bf62-94928d8b9606 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:45:42 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] Lock "cinder-e1b53261-d9bf-4652-997a-6f545d984f9c-delete_volume" acquired by "delete_volume" :: waited 0.159s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:42 devstack sudo[109755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606 1073741824 Aug 05 10:45:42 devstack sudo[109755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] Acquiring lock "cinder-quobyte-e1b53261-d9bf-4652-997a-6f545d984f9c" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] Lock "cinder-quobyte-e1b53261-d9bf-4652-997a-6f545d984f9c" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[75886143-4f73-47c4-8e37-d01d644d8298]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e1b53261-d9bf-4652-997a-6f545d984f9c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:42 devstack sudo[109758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e1b53261-d9bf-4652-997a-6f545d984f9c Aug 05 10:45:42 devstack sudo[109758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:42 devstack sudo[109753]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c" returned: 0 in 0.503s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:43 devstack sudo[109765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c Aug 05 10:45:43 devstack sudo[109765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:43 devstack sudo[109758]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:43 devstack sudo[109755]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e1b53261-d9bf-4652-997a-6f545d984f9c" returned: 0 in 0.464s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e1b53261-d9bf-4652-997a-6f545d984f9c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606 1073741824" returned: 0 in 0.613s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:43 devstack sudo[109771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e1b53261-d9bf-4652-997a-6f545d984f9c Aug 05 10:45:43 devstack sudo[109771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:43 devstack sudo[109765]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04.9c406da0-8010-4ec7-849c-27d80de8739c" returned: 0 in 0.348s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:43 devstack sudo[109774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606 Aug 05 10:45:43 devstack sudo[109774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-9c406da0-8010-4ec7-849c-27d80de8739c" released by "_delete_snapshot" :: held 1.940s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-ab438c55-c758-486c-acf3-28d332065e04" released by "delete_snapshot" :: held 1.990s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] Created reservations ['40239213-c813-4abf-b5fd-7557d6937cc2', '49856c77-997c-41b3-8445-0b18e89e9008', '4296fbb6-62ed-463f-a968-78aede8011b5', 'eb77d594-c6cf-4048-a3ab-b6689fd72b50'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:43 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] Delete snapshot completed successfully. Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-56ba160c-7c43-45e5-9745-961f15948735 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-9c406da0-8010-4ec7-849c-27d80de8739c-delete_snapshot" released by "delete_snapshot" :: held 2.191s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:43 devstack sudo[109771]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-e1b53261-d9bf-4652-997a-6f545d984f9c" returned: 0 in 0.319s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] Lock "cinder-quobyte-e1b53261-d9bf-4652-997a-6f545d984f9c" released by "delete_volume" :: held 0.834s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] Created reservations ['b4c2f3b4-8bec-4077-b02d-ff7f6c5b38f6', 'a6cf6378-e5d8-40a1-8e5e-a1984c1140b6', '5029f1c8-a768-49f6-9ee8-8a936923d3d9', 'a5a8d149-0a4b-4c40-afd4-424411020307'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:43 devstack sudo[109774]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606" returned: 0 in 0.411s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9ccba4-4734-439e-ac3a-38e9a2598076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e94367-8731-456e-9e6b-e13c79dd1a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:43 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Volume volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606 (c8ce35b3-5242-4fe4-bf62-94928d8b9606): created successfully Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e94367-8731-456e-9e6b-e13c79dd1a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (c39032be-3ac8-4cfc-b0e1-154439afd2de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:43 devstack sudo[109778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:43 devstack sudo[109778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:43 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c9a4ab2f-b4ab-4bcb-81bd-84f23a528b2c tempest-ProjectMemberTests-1104312187 None] Created volume successfully. Aug 05 10:45:44 devstack sudo[109778]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.354s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:44 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:44 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] Deleted volume successfully. Aug 05 10:45:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6851a4d2-72b6-4426-8d57-3af90824c794 tempest-ProjectReaderTests-54302117 None] Lock "cinder-e1b53261-d9bf-4652-997a-6f545d984f9c-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-ab438c55-c758-486c-acf3-28d332065e04-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] Creating offline snapshot d5b6c4ac-f5c8-4e8a-806a-987537fa277c of volume c8ce35b3-5242-4fe4-bf62-94928d8b9606 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-ab438c55-c758-486c-acf3-28d332065e04-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b48189-f3cb-46ce-bb4b-7d6a128944ed]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-quobyte-ab438c55-c758-486c-acf3-28d332065e04" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-ab438c55-c758-486c-acf3-28d332065e04" acquired by "delete_volume" :: waited 0.034s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:45 devstack sudo[109787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606 Aug 05 10:45:45 devstack sudo[109787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Flow 'volume_create_manager' (a30576c7-21a9-4419-9208-1f18d996e14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2782924b-6986-493d-bfbd-8850ec578adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[456f7326-d694-4568-9d14-e956c0d7e2a3]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2782924b-6986-493d-bfbd-8850ec578adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-113609806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24eda73c-d3fd-43f3-a61e-2edd28f08740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87df91969af048d89cabce9a0e4f1b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:45Z,use_quota=True,user_id='6f3ebfa437104d7e915b4ae3f7db2331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b77e84d-5727-40ed-9258-82ac4cda12b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b77e84d-5727-40ed-9258-82ac4cda12b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4de413a-eefb-4526-ba60-9f2dff392be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4de413a-eefb-4526-ba60-9f2dff392be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24eda73c-d3fd-43f3-a61e-2edd28f08740', 'volume_name': 'volume-24eda73c-d3fd-43f3-a61e-2edd28f08740', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c996172d-a366-4c91-9d9d-43a77af98b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c996172d-a366-4c91-9d9d-43a77af98b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e504bd-7252-482f-8080-48cec9e84177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:45 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Volume 24eda73c-d3fd-43f3-a61e-2edd28f08740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24eda73c-d3fd-43f3-a61e-2edd28f08740', 'volume_size': 1} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:45 devstack sudo[109789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04 Aug 05 10:45:45 devstack sudo[109789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:45 devstack sudo[109787]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606" returned: 0 in 0.460s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:45 devstack sudo[109795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c 1G Aug 05 10:45:45 devstack sudo[109795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Flow 'volume_create_manager' (8e76289f-5201-4576-8e45-422401fc224e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8443b222-f6d3-41c2-8e2c-da2642e53cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:45 devstack sudo[109789]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04" returned: 0 in 0.445s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8443b222-f6d3-41c2-8e2c-da2642e53cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2001510130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23cc3135-f581-40cf-ac24-6d9e4dbb2f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39c7ae78713a4c1fbcfe49fb1e9c3b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:46Z,use_quota=True,user_id='3fe3d4d32641470b886a48814d253e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6957f9b1-179e-4117-9b19-65d13bbfa538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:45 devstack sudo[109801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04 Aug 05 10:45:45 devstack sudo[109801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6957f9b1-179e-4117-9b19-65d13bbfa538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abc7a93-f0c4-47bb-b8da-d11cbb1f7b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abc7a93-f0c4-47bb-b8da-d11cbb1f7b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23cc3135-f581-40cf-ac24-6d9e4dbb2f4f', 'volume_name': 'volume-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90741bdc-910d-4090-a121-877fb69fddf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90741bdc-910d-4090-a121-877fb69fddf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b274b6-8000-4fa7-b528-98fac8b313a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:45 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Volume 23cc3135-f581-40cf-ac24-6d9e4dbb2f4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f', 'volume_size': 1} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:45 devstack sudo[109795]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c 1G" returned: 0 in 0.427s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:45 devstack sudo[109801]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ab438c55-c758-486c-acf3-28d332065e04" returned: 0 in 0.263s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:45 devstack sudo[109807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c Aug 05 10:45:45 devstack sudo[109807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:45 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-ab438c55-c758-486c-acf3-28d332065e04" released by "delete_volume" :: held 0.817s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] Created reservations ['87bcbae8-f638-4162-91ec-3c5ddc739c6c', '56c86701-7b4a-4676-9362-62db345d58dd', 'afdbd073-7ad8-4d39-b4d9-dc060615c165', 'ea10525c-933b-4913-b9f2-5094ffd744ef'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:46 devstack sudo[109811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:46 devstack sudo[109811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:46 devstack sudo[109807]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c" returned: 0 in 0.354s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:46 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c is being set with open permissions: ugo+rw Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:46 devstack sudo[109814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c Aug 05 10:45:46 devstack sudo[109814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:46 devstack sudo[109811]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.280s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:46 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] Deleted volume successfully. Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-06282fd4-7e3a-4859-8873-f61b4d037c41 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-ab438c55-c758-486c-acf3-28d332065e04-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:46 devstack sudo[109814]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c" returned: 0 in 0.290s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:46 devstack sudo[109818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.info Aug 05 10:45:46 devstack sudo[109818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Flow 'volume_create_manager' (05f81211-e442-4185-8592-2042d16835fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1158ac79-624f-4367-9050-4f2d88bac7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1158ac79-624f-4367-9050-4f2d88bac7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-301789386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca5bd142-4699-4cc1-9d50-01d576f6c05f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b6b72465254f0ba50fcade3ef18a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:47Z,use_quota=True,user_id='6b7cd23726634c2ebad9f38a27db563b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc358f1-914b-4f6b-9d77-045882f96d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc358f1-914b-4f6b-9d77-045882f96d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a7a62d-d639-49de-b6d4-5e099d929439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a7a62d-d639-49de-b6d4-5e099d929439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca5bd142-4699-4cc1-9d50-01d576f6c05f', 'volume_name': 'volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade8d2a7-aca3-4f07-83e7-3a41d809e0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade8d2a7-aca3-4f07-83e7-3a41d809e0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715fc5d5-7fb2-4af9-8e36-1069d4379541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:46 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Volume ca5bd142-4699-4cc1-9d50-01d576f6c05f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f', 'volume_size': 1} Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:46 devstack sudo[109818]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.info" returned: 0 in 0.267s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:46 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.info is being set with open permissions: ugo+rw Aug 05 10:45:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:46 devstack sudo[109821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.info Aug 05 10:45:46 devstack sudo[109821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:47 devstack sudo[109821]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.info" returned: 0 in 0.247s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.834s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-113609806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24eda73c-d3fd-43f3-a61e-2edd28f08740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87df91969af048d89cabce9a0e4f1b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:45Z,use_quota=True,user_id='6f3ebfa437104d7e915b4ae3f7db2331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Creating volume 24eda73c-d3fd-43f3-a61e-2edd28f08740 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:45:47 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:47 devstack sudo[109824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 1073741824 Aug 05 10:45:47 devstack sudo[109824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:47 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7fc85092-1a97-4994-a16c-023b8f3435b0 tempest-ProjectMemberTests-1104312187 None] Create snapshot completed successfully Aug 05 10:45:47 devstack sudo[109824]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 1073741824" returned: 0 in 0.414s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:47 devstack sudo[109829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 Aug 05 10:45:47 devstack sudo[109829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:47 devstack sudo[109829]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740" returned: 0 in 0.243s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.109s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2001510130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23cc3135-f581-40cf-ac24-6d9e4dbb2f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39c7ae78713a4c1fbcfe49fb1e9c3b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:46Z,use_quota=True,user_id='3fe3d4d32641470b886a48814d253e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Creating volume 23cc3135-f581-40cf-ac24-6d9e4dbb2f4f {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:45:47 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e504bd-7252-482f-8080-48cec9e84177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24eda73c-d3fd-43f3-a61e-2edd28f08740', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:47 devstack sudo[109832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f 1073741824 Aug 05 10:45:47 devstack sudo[109832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07ea9a4-57e9-4522-8b23-6cfa3d46bee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:47 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Volume volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 (24eda73c-d3fd-43f3-a61e-2edd28f08740): created successfully Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07ea9a4-57e9-4522-8b23-6cfa3d46bee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:47 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Flow 'volume_create_manager' (a30576c7-21a9-4419-9208-1f18d996e14c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:47 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c24cfe6b-56d7-4df3-9d02-d194a8aa51fb tempest-SnapshotDependencyTests-1284742972 None] Created volume successfully. Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-d5b6c4ac-f5c8-4e8a-806a-987537fa277c-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-d5b6c4ac-f5c8-4e8a-806a-987537fa277c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-c8ce35b3-5242-4fe4-bf62-94928d8b9606" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-c8ce35b3-5242-4fe4-bf62-94928d8b9606" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-d5b6c4ac-f5c8-4e8a-806a-987537fa277c" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-d5b6c4ac-f5c8-4e8a-806a-987537fa277c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] Deleting offline snapshot d5b6c4ac-f5c8-4e8a-806a-987537fa277c of volume c8ce35b3-5242-4fe4-bf62-94928d8b9606 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] snapshot_file for this snap is: volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b19666b-3f26-4f1e-b9cc-32367ffe1b88]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:48 devstack sudo[109832]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f 1073741824" returned: 0 in 0.501s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:48 devstack sudo[109837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c Aug 05 10:45:48 devstack sudo[109837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:48 devstack sudo[109840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f Aug 05 10:45:48 devstack sudo[109840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:48 devstack sudo[109837]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c" returned: 0 in 0.415s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:45:48 devstack sudo[109840]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f" returned: 0 in 0.288s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a548c316-e515-458a-8cd8-de1fa5223d73]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.888s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-301789386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca5bd142-4699-4cc1-9d50-01d576f6c05f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b6b72465254f0ba50fcade3ef18a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:47Z,use_quota=True,user_id='6b7cd23726634c2ebad9f38a27db563b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Creating volume ca5bd142-4699-4cc1-9d50-01d576f6c05f {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:45:48 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:48 devstack sudo[109847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f 1073741824 Aug 05 10:45:48 devstack sudo[109847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b274b6-8000-4fa7-b528-98fac8b313a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec07466c-3a6b-4496-a568-0c5ace141bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:48 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Volume volume-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f (23cc3135-f581-40cf-ac24-6d9e4dbb2f4f): created successfully Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec07466c-3a6b-4496-a568-0c5ace141bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:48 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Flow 'volume_create_manager' (8e76289f-5201-4576-8e45-422401fc224e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:48 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-601a55e5-6d15-4d01-b060-3c9fe05f8f01 tempest-ProjectReaderTests-54302117 None] Created volume successfully. Aug 05 10:45:48 devstack sudo[109848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606 Aug 05 10:45:48 devstack sudo[109848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:49 devstack sudo[109848]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606" returned: 0 in 0.392s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:49 devstack sudo[109847]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:49 devstack sudo[109857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c Aug 05 10:45:49 devstack sudo[109857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f 1073741824" returned: 0 in 0.434s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:49 devstack sudo[109859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f Aug 05 10:45:49 devstack sudo[109859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:49 devstack sudo[109859]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f" returned: 0 in 0.255s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:49 devstack sudo[109857]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.833s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c" returned: 0 in 0.341s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715fc5d5-7fb2-4af9-8e36-1069d4379541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ff11b0-d686-45cb-91d9-f83a65e2d03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:49 devstack sudo[109865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c Aug 05 10:45:49 devstack sudo[109865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] Creating offline snapshot 58c039c9-2fed-4a43-a1fb-ce0668be1f04 of volume 24eda73c-d3fd-43f3-a61e-2edd28f08740 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[47487317-8383-4ad8-ba98-0394c2903e46]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:49 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Volume volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f (ca5bd142-4699-4cc1-9d50-01d576f6c05f): created successfully Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ff11b0-d686-45cb-91d9-f83a65e2d03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Flow 'volume_create_manager' (05f81211-e442-4185-8592-2042d16835fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:49 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-eb6673ca-4ee4-4250-8a86-41bdbe270bdb tempest-ProjectReaderTests-1268733534 None] Created volume successfully. Aug 05 10:45:49 devstack sudo[109867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 Aug 05 10:45:49 devstack sudo[109867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:49 devstack sudo[109865]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606.d5b6c4ac-f5c8-4e8a-806a-987537fa277c" returned: 0 in 0.269s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-d5b6c4ac-f5c8-4e8a-806a-987537fa277c" released by "_delete_snapshot" :: held 1.596s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-c8ce35b3-5242-4fe4-bf62-94928d8b9606" released by "delete_snapshot" :: held 1.630s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] Created reservations ['72d4b93f-b0e6-47a5-922d-5edb90d63992', 'eae8c3a6-90dc-43e4-b674-9fc0602f5eac', 'bbdd1c16-6165-4ceb-a6c2-5beaad012639', '25b2b7ef-e307-462b-b05f-4b1490f89bc1'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:49 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] Delete snapshot completed successfully. Aug 05 10:45:49 devstack sudo[109867]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1ce3144-945d-44be-9386-b5552e444dd7 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-d5b6c4ac-f5c8-4e8a-806a-987537fa277c-delete_snapshot" released by "delete_snapshot" :: held 1.821s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740" returned: 0 in 0.462s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] Acquiring lock "cinder-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] Lock "cinder-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:50 devstack sudo[109873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04 1G Aug 05 10:45:50 devstack sudo[109873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] Acquiring lock "cinder-quobyte-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] Lock "cinder-quobyte-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4701de98-888f-4e61-a5e8-e5cbe42a8888]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:50 devstack sudo[109875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f Aug 05 10:45:50 devstack sudo[109875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-c8ce35b3-5242-4fe4-bf62-94928d8b9606-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-c8ce35b3-5242-4fe4-bf62-94928d8b9606-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-c8ce35b3-5242-4fe4-bf62-94928d8b9606" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-c8ce35b3-5242-4fe4-bf62-94928d8b9606" acquired by "delete_volume" :: waited 0.024s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[989a1fae-6c0e-4388-9398-cee656659367]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:50 devstack sudo[109873]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04 1G" returned: 0 in 0.520s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:50 devstack sudo[109886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04 Aug 05 10:45:50 devstack sudo[109886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:50 devstack sudo[109875]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f" returned: 0 in 0.413s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:50 devstack sudo[109881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606 Aug 05 10:45:50 devstack sudo[109881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:50 devstack sudo[109888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f Aug 05 10:45:50 devstack sudo[109888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:50 devstack sudo[109888]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f" returned: 0 in 0.267s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:50 devstack sudo[109886]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] Lock "cinder-quobyte-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f" released by "delete_volume" :: held 0.729s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04" returned: 0 in 0.332s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:50 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04 is being set with open permissions: ugo+rw Aug 05 10:45:50 devstack sudo[109881]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606" returned: 0 in 0.417s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:50 devstack sudo[109900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04 Aug 05 10:45:50 devstack sudo[109900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:50 devstack sudo[109901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606 Aug 05 10:45:50 devstack sudo[109901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] Created reservations ['ffa0eedd-fb6f-4a9a-847d-040ce3324846', '93a0f2be-06b2-4160-b2ad-527e9bda0b8d', '3ccc4498-60ff-4005-811d-d42305360f83', '5490642b-97b7-497b-adf8-9ebce5a71357'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:51 devstack sudo[109904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:51 devstack sudo[109904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:51 devstack sudo[109900]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04" returned: 0 in 0.288s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:51 devstack sudo[109901]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-c8ce35b3-5242-4fe4-bf62-94928d8b9606" returned: 0 in 0.297s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-c8ce35b3-5242-4fe4-bf62-94928d8b9606" released by "delete_volume" :: held 0.789s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:51 devstack sudo[109908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.info Aug 05 10:45:51 devstack sudo[109908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] Created reservations ['756caaf6-7177-42eb-b075-452fec0e97e0', '3aced923-56ca-4b31-8048-f916ef644a74', '25f84c4c-ee3c-472d-8f98-093467cb1de2', '2eadac54-a3cd-4d7b-a264-78221501ef9e'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:51 devstack sudo[109904]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.276s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:51 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] Deleted volume successfully. Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7ab4ba93-b285-4dd3-bd3f-1dc464e02d23 tempest-ProjectReaderTests-54302117 None] Lock "cinder-23cc3135-f581-40cf-ac24-6d9e4dbb2f4f-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:51 devstack sudo[109911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:51 devstack sudo[109911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:51 devstack sudo[109908]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.info" returned: 0 in 0.312s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:51 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.info is being set with open permissions: ugo+rw Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:51 devstack sudo[109914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.info Aug 05 10:45:51 devstack sudo[109914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:51 devstack sudo[109911]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.388s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:51 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] Deleted volume successfully. Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8603875b-b653-4578-8001-43bf9d17fdc0 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-c8ce35b3-5242-4fe4-bf62-94928d8b9606-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Flow 'volume_create_manager' (2c1d2aae-04ee-4a10-a046-0dde6a1990e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572ee555-f0ec-4d61-8fed-61799e77f4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:51 devstack sudo[109914]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572ee555-f0ec-4d61-8fed-61799e77f4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1752530593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d88d9d94-27b4-49a0-bdf3-9f86f5da1d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39c7ae78713a4c1fbcfe49fb1e9c3b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:52Z,use_quota=True,user_id='3fe3d4d32641470b886a48814d253e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe7298b-0b99-41c1-b31a-d3d07dd1921a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe7298b-0b99-41c1-b31a-d3d07dd1921a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110c7dbf-b90b-4f4c-be23-ae8e10a81857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110c7dbf-b90b-4f4c-be23-ae8e10a81857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd88d9d94-27b4-49a0-bdf3-9f86f5da1d28', 'volume_name': 'volume-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8770533d-6f61-4574-b6e0-6a2cf7ab9152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8770533d-6f61-4574-b6e0-6a2cf7ab9152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a04828-9ec0-4c0e-8b03-3a01c5bdd797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:51 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Volume d88d9d94-27b4-49a0-bdf3-9f86f5da1d28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28', 'volume_size': 1} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.info" returned: 0 in 0.385s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.449s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.764s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] Creating offline snapshot 85b672d3-8468-49a2-b36e-9714e0edc014 of volume ca5bd142-4699-4cc1-9d50-01d576f6c05f {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:45:51 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8717301f-ad16-4d25-86f3-a01216b11ea7 tempest-SnapshotDependencyTests-1284742972 None] Create snapshot completed successfully Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3c0e4f-706e-4d32-bd31-3acdac37923f]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:51 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:52 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:45:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (ee93d199-bd21-4708-a877-d11082d5a3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6f78f2-bc78-4b1f-9f30-00ae896c07a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6f78f2-bc78-4b1f-9f30-00ae896c07a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258016200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec758e4c-3250-48a4-ac6d-367423ddb132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:52Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a680e1-5b05-420c-8037-037ae3ce3ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:52 devstack sudo[109918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f Aug 05 10:45:52 devstack sudo[109918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a680e1-5b05-420c-8037-037ae3ce3ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be159143-22da-4050-a612-8150474e485f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be159143-22da-4050-a612-8150474e485f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec758e4c-3250-48a4-ac6d-367423ddb132', 'volume_name': 'volume-ec758e4c-3250-48a4-ac6d-367423ddb132', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd98aa6-bf91-43b1-ae96-e5c81d58d486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd98aa6-bf91-43b1-ae96-e5c81d58d486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:52 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a50545-f36a-4ece-a96d-9f942c19870c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:52 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Volume ec758e4c-3250-48a4-ac6d-367423ddb132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec758e4c-3250-48a4-ac6d-367423ddb132', 'volume_size': 1} Aug 05 10:45:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:52 devstack sudo[109918]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f" returned: 0 in 0.382s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:52 devstack sudo[109923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014 1G Aug 05 10:45:52 devstack sudo[109923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:52 devstack sudo[109923]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014 1G" returned: 0 in 0.411s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:52 devstack sudo[109929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014 Aug 05 10:45:52 devstack sudo[109929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:53 devstack sudo[109929]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014" returned: 0 in 0.296s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:53 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014 is being set with open permissions: ugo+rw Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:53 devstack sudo[109934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014 Aug 05 10:45:53 devstack sudo[109934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:53 devstack sudo[109934]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014" returned: 0 in 0.252s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:53 devstack sudo[109937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.info Aug 05 10:45:53 devstack sudo[109937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Flow 'volume_create_manager' (d9178d0f-8343-41e6-95ae-2e1f77f914c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b43110f-b6dc-4414-a654-27dac4edc52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b43110f-b6dc-4414-a654-27dac4edc52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8a1ae1-a01a-4377-a50f-22b92b014bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87df91969af048d89cabce9a0e4f1b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=58c039c9-2fed-4a43-a1fb-ce0668be1f04,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:53Z,use_quota=True,user_id='6f3ebfa437104d7e915b4ae3f7db2331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b89f446-0b9c-416f-8070-2a0386e649b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b89f446-0b9c-416f-8070-2a0386e649b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b6d27a-778c-4b67-8aa5-99a7f15114bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b6d27a-778c-4b67-8aa5-99a7f15114bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f8a1ae1-a01a-4377-a50f-22b92b014bf9', 'volume_name': 'volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9', 'volume_size': 1, 'snapshot_id': '58c039c9-2fed-4a43-a1fb-ce0668be1f04'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4812ac6-26be-4c49-ae05-766e20f9fad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4812ac6-26be-4c49-ae05-766e20f9fad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe22fcf-7ecd-4787-9635-d54a106da473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:53 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Volume 4f8a1ae1-a01a-4377-a50f-22b92b014bf9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9', 'volume_size': 1, 'snapshot_id': '58c039c9-2fed-4a43-a1fb-ce0668be1f04'} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:53 devstack sudo[109937]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.info" returned: 0 in 0.255s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:53 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.info is being set with open permissions: ugo+rw Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:53 devstack sudo[109940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.info Aug 05 10:45:53 devstack sudo[109940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:53 devstack sudo[109940]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.info" returned: 0 in 0.239s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.958s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1752530593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d88d9d94-27b4-49a0-bdf3-9f86f5da1d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39c7ae78713a4c1fbcfe49fb1e9c3b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:52Z,use_quota=True,user_id='3fe3d4d32641470b886a48814d253e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Creating volume d88d9d94-27b4-49a0-bdf3-9f86f5da1d28 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:45:53 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:45:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:53 devstack sudo[109943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28 1073741824 Aug 05 10:45:53 devstack sudo[109943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:53 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-48a04e63-193a-4995-a160-d2ba05d24d86 tempest-ProjectReaderTests-1268733534 None] Create snapshot completed successfully Aug 05 10:45:54 devstack sudo[109943]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28 1073741824" returned: 0 in 0.419s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-85b672d3-8468-49a2-b36e-9714e0edc014-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-85b672d3-8468-49a2-b36e-9714e0edc014-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-quobyte-ca5bd142-4699-4cc1-9d50-01d576f6c05f" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:54 devstack sudo[109949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28 Aug 05 10:45:54 devstack sudo[109949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-ca5bd142-4699-4cc1-9d50-01d576f6c05f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-quobyte-85b672d3-8468-49a2-b36e-9714e0edc014" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-85b672d3-8468-49a2-b36e-9714e0edc014" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] Deleting offline snapshot 85b672d3-8468-49a2-b36e-9714e0edc014 of volume ca5bd142-4699-4cc1-9d50-01d576f6c05f {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] snapshot_file for this snap is: volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[43351b40-038b-46a3-8fc1-8d9b3dd634ae]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:54 devstack sudo[109951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014 Aug 05 10:45:54 devstack sudo[109951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:54 devstack sudo[109949]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28" returned: 0 in 0.279s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.493s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258016200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec758e4c-3250-48a4-ac6d-367423ddb132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:45:52Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Creating volume ec758e4c-3250-48a4-ac6d-367423ddb132 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:45:54 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:54 devstack sudo[109954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132 1073741824 Aug 05 10:45:54 devstack sudo[109954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a04828-9ec0-4c0e-8b03-3a01c5bdd797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e09fc4-1adc-45b8-8f44-a4f7fc39771c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:54 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Volume volume-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28 (d88d9d94-27b4-49a0-bdf3-9f86f5da1d28): created successfully Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e09fc4-1adc-45b8-8f44-a4f7fc39771c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Flow 'volume_create_manager' (2c1d2aae-04ee-4a10-a046-0dde6a1990e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:54 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7ea58f1a-98aa-4213-9f43-1d98a228b2b7 tempest-ProjectReaderTests-54302117 None] Created volume successfully. Aug 05 10:45:54 devstack sudo[109951]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014" returned: 0 in 0.398s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[74afa43c-8753-4d8f-b3a7-674d22607855]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] Acquiring lock "cinder-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] Lock "cinder-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] Acquiring lock "cinder-quobyte-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] Lock "cinder-quobyte-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28" acquired by "delete_volume" :: waited 0.027s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:54 devstack sudo[109962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f Aug 05 10:45:54 devstack sudo[109962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5b1eca-1439-4b38-9440-dfbd5ca2b130]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:55 devstack sudo[109966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28 Aug 05 10:45:55 devstack sudo[109966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:55 devstack sudo[109954]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132 1073741824" returned: 0 in 0.515s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:55 devstack sudo[109968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132 Aug 05 10:45:55 devstack sudo[109968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:55 devstack sudo[109962]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f" returned: 0 in 0.428s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:55 devstack sudo[109973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014 Aug 05 10:45:55 devstack sudo[109973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:55 devstack sudo[109966]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28" returned: 0 in 0.399s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:55 devstack sudo[109979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28 Aug 05 10:45:55 devstack sudo[109979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:55 devstack sudo[109968]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132" returned: 0 in 0.281s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.962s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Acquiring lock "cinder-quobyte-58c039c9-2fed-4a43-a1fb-ce0668be1f04-4f8a1ae1-a01a-4377-a50f-22b92b014bf9" by "_create_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a50545-f36a-4ece-a96d-9f942c19870c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec758e4c-3250-48a4-ac6d-367423ddb132', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fcfd78d-4401-4f4d-a190-a8a0c5d64a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-quobyte-58c039c9-2fed-4a43-a1fb-ce0668be1f04-4f8a1ae1-a01a-4377-a50f-22b92b014bf9" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Creating volume 4f8a1ae1-a01a-4377-a50f-22b92b014bf9 from snapshot 58c039c9-2fed-4a43-a1fb-ce0668be1f04 {{(pid=88736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Acquiring lock "cinder-quobyte-4f8a1ae1-a01a-4377-a50f-22b92b014bf9" by "_copy_volume_from_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:55 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Volume volume-ec758e4c-3250-48a4-ac6d-367423ddb132 (ec758e4c-3250-48a4-ac6d-367423ddb132): created successfully Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fcfd78d-4401-4f4d-a190-a8a0c5d64a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (ee93d199-bd21-4708-a877-d11082d5a3c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-quobyte-4f8a1ae1-a01a-4377-a50f-22b92b014bf9" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] snapshot: 58c039c9-2fed-4a43-a1fb-ce0668be1f04, volume: 4f8a1ae1-a01a-4377-a50f-22b92b014bf9, {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 10:45:55 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-f095f357-0717-42b5-b20f-15905bcb350d tempest-ProjectMemberTests-1104312187 None] Created volume successfully. Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[656350dc-9af6-428b-adb0-25dbc9b667cf]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:55 devstack sudo[109979]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28" returned: 0 in 0.268s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] Lock "cinder-quobyte-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28" released by "delete_volume" :: held 0.714s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:55 devstack sudo[109973]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014" returned: 0 in 0.417s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:55 devstack sudo[109984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04 Aug 05 10:45:55 devstack sudo[109984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:55 devstack sudo[109986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014 Aug 05 10:45:55 devstack sudo[109986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] Created reservations ['b74a6a5f-9063-437a-9dbc-d93c3693b4d4', 'ed716aa1-2667-4d68-8676-99472ac558e3', '75147d6e-0a38-42ca-9173-4e3d7113f7d3', 'bcfcdbdc-ea77-46dd-a213-5a9c67bb396b'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:55 devstack sudo[109989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:55 devstack sudo[109989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:55 devstack sudo[109986]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f.85b672d3-8468-49a2-b36e-9714e0edc014" returned: 0 in 0.248s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:55 devstack sudo[109984]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-85b672d3-8468-49a2-b36e-9714e0edc014" released by "_delete_snapshot" :: held 1.610s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-ca5bd142-4699-4cc1-9d50-01d576f6c05f" released by "delete_snapshot" :: held 1.637s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04" returned: 0 in 0.413s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24eda73c-d3fd-43f3-a61e-2edd28f08740(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d885ed4e-bb98-41fd-8bbd-9b79465986c0]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] Created reservations ['ef13a59f-cdbf-494f-9167-0864eca7df28', '44170b2e-84d7-4cba-b65c-d67491e6a99d', '50476259-e35a-4efc-8057-c368fce18320', 'd5194f92-b72f-4de0-a02b-2c32b61814ff'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:56 devstack sudo[109989]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.289s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:56 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] Deleted volume successfully. Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-97063306-06ed-42de-8823-746dbc10b545 tempest-ProjectReaderTests-54302117 None] Lock "cinder-d88d9d94-27b4-49a0-bdf3-9f86f5da1d28-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:56 devstack sudo[109995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 Aug 05 10:45:56 devstack sudo[109995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:56 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] Delete snapshot completed successfully. Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16089656-17b9-4e28-a333-7cc6cf9c92e9 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-85b672d3-8468-49a2-b36e-9714e0edc014-delete_snapshot" released by "delete_snapshot" :: held 1.864s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:56 devstack sudo[109995]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740" returned: 0 in 0.494s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] will copy from snapshot at /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Creating direct copy from snapshot {{(pid=88736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG cinder.utils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Path /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9 not found in is_blk_device check {{(pid=88736) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-ca5bd142-4699-4cc1-9d50-01d576f6c05f-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:56 devstack sudo[110001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9 Aug 05 10:45:56 devstack sudo[110001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-ca5bd142-4699-4cc1-9d50-01d576f6c05f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-quobyte-ca5bd142-4699-4cc1-9d50-01d576f6c05f" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-ca5bd142-4699-4cc1-9d50-01d576f6c05f" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e04cd3a-c6cf-4e2a-a660-610632429c60]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:45:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:56 devstack sudo[110003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f Aug 05 10:45:56 devstack sudo[110003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:57 devstack sudo[110003]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f" returned: 0 in 0.448s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:57 devstack sudo[110018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f Aug 05 10:45:57 devstack sudo[110018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:57 devstack sudo[110018]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ca5bd142-4699-4cc1-9d50-01d576f6c05f" returned: 0 in 0.727s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-ca5bd142-4699-4cc1-9d50-01d576f6c05f" released by "delete_volume" :: held 1.262s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:45:58 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] Created reservations ['78af07b8-e06e-4211-9d62-62ec69eac26e', '439f73a2-3df2-49b7-85d3-c5c4ee7373f2', '4283685c-0b2d-4757-835f-4d93ca288586', '21c0509a-f6ef-430d-9537-ef4a7084f2e2'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:45:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:45:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:45:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:45:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:45:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:45:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:45:58 devstack sudo[110022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:45:58 devstack sudo[110022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:45:58 devstack sudo[110022]: pam_unix(sudo:session): session closed for user root Aug 05 10:45:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.590s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:45:58 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:45:58 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] Deleted volume successfully. Aug 05 10:45:59 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e7d099a6-e479-46ce-b619-17a2b8729829 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-ca5bd142-4699-4cc1-9d50-01d576f6c05f-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:00 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:46:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Flow 'volume_create_manager' (5f4850ed-f839-4c7d-ba17-611551cafbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea6bd9b-01fb-4a7b-a718-c0365f6c1a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea6bd9b-01fb-4a7b-a718-c0365f6c1a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1626824701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00d250b-0539-404a-a2da-9592eae54106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b6b72465254f0ba50fcade3ef18a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:00Z,use_quota=True,user_id='6b7cd23726634c2ebad9f38a27db563b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0daaa99f-092a-4575-89a3-8f1687911817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0daaa99f-092a-4575-89a3-8f1687911817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabcf4d1-1f09-4be1-9c35-28ef42d52488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabcf4d1-1f09-4be1-9c35-28ef42d52488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a00d250b-0539-404a-a2da-9592eae54106', 'volume_name': 'volume-a00d250b-0539-404a-a2da-9592eae54106', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f8146e-ff97-4740-a3bd-fe5d20683fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f8146e-ff97-4740-a3bd-fe5d20683fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:00 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6e4273-db12-47c6-b1b7-2a0d8798c44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:00 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Volume a00d250b-0539-404a-a2da-9592eae54106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a00d250b-0539-404a-a2da-9592eae54106', 'volume_size': 1} Aug 05 10:46:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:01 devstack sudo[110001]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9" returned: 0 in 5.385s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:01 devstack cinder-volume[88736]: DEBUG cinder.image.image_utils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Image conversion details: src /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9 {{(pid=88736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 10:46:01 devstack cinder-volume[88736]: INFO cinder.image.image_utils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Converted 1024.00 MB image at 190.11 MB/s Aug 05 10:46:01 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9 is being set with open permissions: ugo+rw Aug 05 10:46:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:01 devstack sudo[110026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9 Aug 05 10:46:01 devstack sudo[110026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:02 devstack sudo[110026]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9" returned: 0 in 0.236s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-quobyte-4f8a1ae1-a01a-4377-a50f-22b92b014bf9" released by "_copy_volume_from_snapshot" :: held 6.625s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-quobyte-58c039c9-2fed-4a43-a1fb-ce0668be1f04-4f8a1ae1-a01a-4377-a50f-22b92b014bf9" released by "_create_volume_from_snapshot" :: held 6.712s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.752s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.737s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] Creating offline snapshot 2a86009e-8196-4831-a1f2-d0a9b5b9f970 of volume ec758e4c-3250-48a4-ac6d-367423ddb132 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe22fcf-7ecd-4787-9635-d54a106da473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9', 'volume_size': 1, 'snapshot_id': '58c039c9-2fed-4a43-a1fb-ce0668be1f04'}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb2148e-9a98-4322-9136-fe5cba883226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23d6ae4-0cc6-44d0-93e2-8d28514ba54b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:02 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Volume volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9 (4f8a1ae1-a01a-4377-a50f-22b92b014bf9): created successfully Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb2148e-9a98-4322-9136-fe5cba883226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Flow 'volume_create_manager' (d9178d0f-8343-41e6-95ae-2e1f77f914c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:02 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-172c3f66-1632-4211-9a34-8b1ea1373987 tempest-SnapshotDependencyTests-1284742972 None] Created volume successfully. Aug 05 10:46:02 devstack sudo[110029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132 Aug 05 10:46:02 devstack sudo[110029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] Acquiring lock "cinder-58c039c9-2fed-4a43-a1fb-ce0668be1f04-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-58c039c9-2fed-4a43-a1fb-ce0668be1f04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] Acquiring lock "cinder-quobyte-24eda73c-d3fd-43f3-a61e-2edd28f08740" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-quobyte-24eda73c-d3fd-43f3-a61e-2edd28f08740" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] Acquiring lock "cinder-quobyte-58c039c9-2fed-4a43-a1fb-ce0668be1f04" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-quobyte-58c039c9-2fed-4a43-a1fb-ce0668be1f04" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] Deleting offline snapshot 58c039c9-2fed-4a43-a1fb-ce0668be1f04 of volume 24eda73c-d3fd-43f3-a61e-2edd28f08740 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] snapshot_file for this snap is: volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[646f5cec-e89b-4d6c-aea5-0a6b412d28c1]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:02 devstack sudo[110029]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132" returned: 0 in 0.368s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:02 devstack sudo[110035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970 1G Aug 05 10:46:02 devstack sudo[110035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:02 devstack sudo[110031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04 Aug 05 10:46:02 devstack sudo[110031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:02 devstack sudo[110031]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04" returned: 0 in 0.367s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24eda73c-d3fd-43f3-a61e-2edd28f08740(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[275a03fd-98a5-426c-9dab-ccbba68e3b48]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:03 devstack sudo[110035]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970 1G" returned: 0 in 0.409s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec758e4c-3250-48a4-ac6d-367423ddb132 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:03 devstack sudo[110044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 Aug 05 10:46:03 devstack sudo[110044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:03 devstack sudo[110045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec758e4c-3250-48a4-ac6d-367423ddb132 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970 Aug 05 10:46:03 devstack sudo[110045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:03 devstack sudo[110045]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec758e4c-3250-48a4-ac6d-367423ddb132 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970" returned: 0 in 0.275s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:03 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970 is being set with open permissions: ugo+rw Aug 05 10:46:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:03 devstack sudo[110053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970 Aug 05 10:46:03 devstack sudo[110053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:03 devstack sudo[110044]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740" returned: 0 in 0.538s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:03 devstack sudo[110056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04 Aug 05 10:46:03 devstack sudo[110056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:03 devstack sudo[110053]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970" returned: 0 in 0.253s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:03 devstack sudo[110059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.info Aug 05 10:46:03 devstack sudo[110059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:03 devstack sudo[110056]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04" returned: 0 in 0.342s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:03 devstack sudo[110059]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.info" returned: 0 in 0.253s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:03 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.info is being set with open permissions: ugo+rw Aug 05 10:46:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:03 devstack sudo[110065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04 Aug 05 10:46:03 devstack sudo[110065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:03 devstack sudo[110067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.info Aug 05 10:46:03 devstack sudo[110067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:04 devstack sudo[110065]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740.58c039c9-2fed-4a43-a1fb-ce0668be1f04" returned: 0 in 0.247s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:04 devstack sudo[110067]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.info" returned: 0 in 0.251s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.897s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-quobyte-58c039c9-2fed-4a43-a1fb-ce0668be1f04" released by "_delete_snapshot" :: held 1.609s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.576s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1626824701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00d250b-0539-404a-a2da-9592eae54106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b6b72465254f0ba50fcade3ef18a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:00Z,use_quota=True,user_id='6b7cd23726634c2ebad9f38a27db563b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Creating volume a00d250b-0539-404a-a2da-9592eae54106 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:46:04 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-quobyte-24eda73c-d3fd-43f3-a61e-2edd28f08740" released by "delete_snapshot" :: held 1.657s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:04 devstack sudo[110071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106 1073741824 Aug 05 10:46:04 devstack sudo[110071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:04 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-6ddb2f0f-2e93-496f-a40b-007d14b6cb92 tempest-ProjectMemberTests-1104312187 None] Create snapshot completed successfully Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] Created reservations ['20559b98-0970-4a89-8d7d-64a5853f2164', '8487b14c-3e6c-499f-bb15-12bdefa1e1bf', 'c8378966-c6ec-4cc7-8396-16b7b438249e', '4044d257-da15-4f36-a577-63acde1b0eae'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:04 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] Delete snapshot completed successfully. Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-05837620-33a9-4d17-a2b9-4573cbac7813 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-58c039c9-2fed-4a43-a1fb-ce0668be1f04-delete_snapshot" released by "delete_snapshot" :: held 1.804s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:04 devstack sudo[110071]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106 1073741824" returned: 0 in 0.434s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] Acquiring lock "cinder-24eda73c-d3fd-43f3-a61e-2edd28f08740-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:04 devstack sudo[110077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106 Aug 05 10:46:04 devstack sudo[110077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-24eda73c-d3fd-43f3-a61e-2edd28f08740-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] Acquiring lock "cinder-quobyte-24eda73c-d3fd-43f3-a61e-2edd28f08740" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-quobyte-24eda73c-d3fd-43f3-a61e-2edd28f08740" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c28f8b-cdc9-4f93-91c8-712089bd66bf]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:04 devstack sudo[110077]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106" returned: 0 in 0.278s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6e4273-db12-47c6-b1b7-2a0d8798c44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a00d250b-0539-404a-a2da-9592eae54106', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871c96c3-e381-4fd1-aa77-9e5488343429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:04 devstack sudo[110079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 Aug 05 10:46:04 devstack sudo[110079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:04 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Volume volume-a00d250b-0539-404a-a2da-9592eae54106 (a00d250b-0539-404a-a2da-9592eae54106): created successfully Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871c96c3-e381-4fd1-aa77-9e5488343429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:04 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Flow 'volume_create_manager' (5f4850ed-f839-4c7d-ba17-611551cafbd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:04 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c4efd7a0-666f-45be-b288-5781cad7e4ad tempest-ProjectReaderTests-1268733534 None] Created volume successfully. Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-2a86009e-8196-4831-a1f2-d0a9b5b9f970-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-2a86009e-8196-4831-a1f2-d0a9b5b9f970-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-ec758e4c-3250-48a4-ac6d-367423ddb132" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-ec758e4c-3250-48a4-ac6d-367423ddb132" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-2a86009e-8196-4831-a1f2-d0a9b5b9f970" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-2a86009e-8196-4831-a1f2-d0a9b5b9f970" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] Deleting offline snapshot 2a86009e-8196-4831-a1f2-d0a9b5b9f970 of volume ec758e4c-3250-48a4-ac6d-367423ddb132 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] snapshot_file for this snap is: volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[864f23a7-4b11-4c1c-9d91-b2d39a59c7bb]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:05 devstack sudo[110079]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740" returned: 0 in 0.374s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:05 devstack sudo[110086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740 Aug 05 10:46:05 devstack sudo[110086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:05 devstack sudo[110085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970 Aug 05 10:46:05 devstack sudo[110085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:05 devstack sudo[110086]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-24eda73c-d3fd-43f3-a61e-2edd28f08740" returned: 0 in 0.251s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-quobyte-24eda73c-d3fd-43f3-a61e-2edd28f08740" released by "delete_volume" :: held 0.723s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] Created reservations ['24703df4-7a13-4b0d-9fa5-91ef8f4aca1d', 'db55814e-4915-4c05-abce-f44b5d5e20b2', '366e6c67-2267-4da3-9f66-e4e0d82ce483', '2dbcf542-fac4-41f4-bcb6-7b83107ec614'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:05 devstack sudo[110085]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970" returned: 0 in 0.382s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec758e4c-3250-48a4-ac6d-367423ddb132(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87c924a-2cea-4aff-b173-09e2ae0c9d2b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:05 devstack sudo[110094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:46:05 devstack sudo[110094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:05 devstack sudo[110093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132 Aug 05 10:46:05 devstack sudo[110093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] Acquiring lock "cinder-4f8a1ae1-a01a-4377-a50f-22b92b014bf9-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-4f8a1ae1-a01a-4377-a50f-22b92b014bf9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] Creating offline snapshot bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6 of volume a00d250b-0539-404a-a2da-9592eae54106 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] Acquiring lock "cinder-quobyte-4f8a1ae1-a01a-4377-a50f-22b92b014bf9" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ab6641-17bc-4d96-9434-dce1663ecff2]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:05 devstack sudo[110094]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-quobyte-4f8a1ae1-a01a-4377-a50f-22b92b014bf9" acquired by "delete_volume" :: waited 0.036s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.349s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:46:05 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] Deleted volume successfully. Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd64e9c-1d30-49d2-a152-0f9f6ced8d0c]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5a77cb70-0c2b-42f8-a915-77db94d58da2 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-24eda73c-d3fd-43f3-a61e-2edd28f08740-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:05 devstack sudo[110093]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132" returned: 0 in 0.475s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:05 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:06 devstack sudo[110103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970 Aug 05 10:46:06 devstack sudo[110103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:06 devstack sudo[110100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106 Aug 05 10:46:06 devstack sudo[110100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:06 devstack sudo[110102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9 Aug 05 10:46:06 devstack sudo[110102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:06 devstack sudo[110100]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106" returned: 0 in 0.389s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:06 devstack sudo[110118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6 1G Aug 05 10:46:06 devstack sudo[110118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:06 devstack sudo[110102]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9" returned: 0 in 0.397s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:06 devstack sudo[110103]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970" returned: 0 in 0.373s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:06 devstack sudo[110120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9 Aug 05 10:46:06 devstack sudo[110120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:06 devstack sudo[110122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970 Aug 05 10:46:06 devstack sudo[110122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:06 devstack sudo[110120]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-4f8a1ae1-a01a-4377-a50f-22b92b014bf9" returned: 0 in 0.252s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-quobyte-4f8a1ae1-a01a-4377-a50f-22b92b014bf9" released by "delete_volume" :: held 0.704s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:06 devstack sudo[110122]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132.2a86009e-8196-4831-a1f2-d0a9b5b9f970" returned: 0 in 0.267s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-2a86009e-8196-4831-a1f2-d0a9b5b9f970" released by "_delete_snapshot" :: held 1.610s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-ec758e4c-3250-48a4-ac6d-367423ddb132" released by "delete_snapshot" :: held 1.630s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] Created reservations ['58bf9b92-4076-4a90-ab21-19a09e90c2ab', 'b642d050-06d6-4b03-b760-56e03c226d72', 'd285dba1-d35a-4d30-8ac0-d067257cc01a', '34bfd7bb-fc37-4e1a-864d-13657ea6029b'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:06 devstack sudo[110118]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6 1G" returned: 0 in 0.459s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a00d250b-0539-404a-a2da-9592eae54106 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] Created reservations ['f1fa1930-7aae-4997-96d3-fe2a54bdc4e0', 'fbd75a51-edc6-43d7-8ab9-82725e05b6f2', 'ce9c3942-3017-4288-87b4-2a89d847758e', '692058ac-b498-4aea-b404-bb0a342ee052'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:06 devstack sudo[110130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a00d250b-0539-404a-a2da-9592eae54106 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6 Aug 05 10:46:06 devstack sudo[110130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:06 devstack sudo[110132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:46:06 devstack sudo[110132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:06 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] Delete snapshot completed successfully. Aug 05 10:46:06 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-9445563f-242c-4c83-8c39-63a1d0ae659e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-2a86009e-8196-4831-a1f2-d0a9b5b9f970-delete_snapshot" released by "delete_snapshot" :: held 1.837s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:07 devstack sudo[110130]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:07 devstack sudo[110132]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.278s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a00d250b-0539-404a-a2da-9592eae54106 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6" returned: 0 in 0.347s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:46:07 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6 is being set with open permissions: ugo+rw Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:07 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] Deleted volume successfully. Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3914d384-7166-4b58-8488-184fe73c9be3 tempest-SnapshotDependencyTests-1284742972 None] Lock "cinder-4f8a1ae1-a01a-4377-a50f-22b92b014bf9-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:07 devstack sudo[110139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6 Aug 05 10:46:07 devstack sudo[110139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-ec758e4c-3250-48a4-ac6d-367423ddb132-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-ec758e4c-3250-48a4-ac6d-367423ddb132-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-ec758e4c-3250-48a4-ac6d-367423ddb132" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-ec758e4c-3250-48a4-ac6d-367423ddb132" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cb5b59-764f-49ac-b77d-2d061ccc1a59]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:07 devstack sudo[110139]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6" returned: 0 in 0.316s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:07 devstack sudo[110143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.info Aug 05 10:46:07 devstack sudo[110143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:07 devstack sudo[110142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132 Aug 05 10:46:07 devstack sudo[110142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:07 devstack sudo[110143]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.info" returned: 0 in 0.282s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:07 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.info is being set with open permissions: ugo+rw Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:07 devstack sudo[110150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.info Aug 05 10:46:07 devstack sudo[110150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:07 devstack sudo[110142]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132" returned: 0 in 0.397s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:07 devstack sudo[110152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132 Aug 05 10:46:07 devstack sudo[110152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:07 devstack sudo[110150]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:07 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.info" returned: 0 in 0.259s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.185s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:08 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1569e661-6ddb-45b8-8032-e647782324f7 tempest-ProjectReaderTests-1268733534 None] Create snapshot completed successfully Aug 05 10:46:08 devstack sudo[110152]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ec758e4c-3250-48a4-ac6d-367423ddb132" returned: 0 in 0.291s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-ec758e4c-3250-48a4-ac6d-367423ddb132" released by "delete_volume" :: held 0.765s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] Created reservations ['4e8904dd-aeb2-405b-8d60-b48a74a36902', '5f873685-a12f-4309-b627-cf9b4be6e8fd', '73c222d6-3d43-4efe-9ba8-99342d5b4028', '35911332-a3c2-408d-a0d1-b86aa31be1c8'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:08 devstack sudo[110156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:46:08 devstack sudo[110156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:08 devstack sudo[110156]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.274s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:46:08 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] Deleted volume successfully. Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3add2058-31c0-403a-b40f-6b2d040b0560 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-ec758e4c-3250-48a4-ac6d-367423ddb132-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (f20061db-ef5e-42cd-990f-7e9a7cb94e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7586d458-5a4a-4ddd-872e-4ba5ac06fe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7586d458-5a4a-4ddd-872e-4ba5ac06fe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1077961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327901d1-9be1-4da8-a89c-307c266f0516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:09Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28a0a7c-3ea2-4304-87c4-6d4e85e4376f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:08 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28a0a7c-3ea2-4304-87c4-6d4e85e4376f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8626260-1a9e-4008-abf7-257f957898bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8626260-1a9e-4008-abf7-257f957898bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '327901d1-9be1-4da8-a89c-307c266f0516', 'volume_name': 'volume-327901d1-9be1-4da8-a89c-307c266f0516', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b123e5ca-05a0-4629-a295-8c2e88a162ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b123e5ca-05a0-4629-a295-8c2e88a162ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587c4672-7f49-46ad-b51b-d02659799ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:09 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Volume 327901d1-9be1-4da8-a89c-307c266f0516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-327901d1-9be1-4da8-a89c-307c266f0516', 'volume_size': 1} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1077961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327901d1-9be1-4da8-a89c-307c266f0516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:09Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Creating volume 327901d1-9be1-4da8-a89c-307c266f0516 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:46:09 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:09 devstack sudo[110159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516 1073741824 Aug 05 10:46:09 devstack sudo[110159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] Lock "cinder-bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-quobyte-a00d250b-0539-404a-a2da-9592eae54106" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-a00d250b-0539-404a-a2da-9592eae54106" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-quobyte-bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] Deleting offline snapshot bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6 of volume a00d250b-0539-404a-a2da-9592eae54106 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] snapshot_file for this snap is: volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8133c12c-38a0-40e9-a6b4-d19ef0382bdf]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:09 devstack sudo[110161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6 Aug 05 10:46:09 devstack sudo[110161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:09 devstack sudo[110159]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516 1073741824" returned: 0 in 0.497s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:09 devstack sudo[110171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516 Aug 05 10:46:09 devstack sudo[110171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:09 devstack sudo[110161]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6" returned: 0 in 0.467s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a00d250b-0539-404a-a2da-9592eae54106(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4683d0d7-72fc-462e-9359-dd5713b3253b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:09 devstack sudo[110173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106 Aug 05 10:46:09 devstack sudo[110173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:09 devstack sudo[110171]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516" returned: 0 in 0.268s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587c4672-7f49-46ad-b51b-d02659799ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-327901d1-9be1-4da8-a89c-307c266f0516', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9be387-1650-40cf-aa56-4cd787883bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:09 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Volume volume-327901d1-9be1-4da8-a89c-307c266f0516 (327901d1-9be1-4da8-a89c-307c266f0516): created successfully Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9be387-1650-40cf-aa56-4cd787883bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:09 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (f20061db-ef5e-42cd-990f-7e9a7cb94e82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:09 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-44a5cd0f-4a4c-426e-92f2-07901e5b72a9 tempest-ProjectMemberTests-1104312187 None] Created volume successfully. Aug 05 10:46:10 devstack sudo[110173]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106" returned: 0 in 0.423s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:10 devstack sudo[110179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6 Aug 05 10:46:10 devstack sudo[110179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:10 devstack sudo[110179]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6" returned: 0 in 0.355s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:10 devstack sudo[110185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6 Aug 05 10:46:10 devstack sudo[110185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:10 devstack sudo[110185]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:10 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106.bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6" returned: 0 in 0.307s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6" released by "_delete_snapshot" :: held 1.671s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-a00d250b-0539-404a-a2da-9592eae54106" released by "delete_snapshot" :: held 1.695s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:10 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] Created reservations ['a3ee56ed-5320-47f9-9a8a-29e5f37eef06', 'd636d9c3-d827-4ad3-b337-753831338486', 'ad059e40-345e-437c-9357-643023169552', 'cf16e24b-f1e7-4673-b9d9-0fd471661c0b'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:10 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] Delete snapshot completed successfully. Aug 05 10:46:10 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-74463329-a16b-4ab6-af08-08962b5e4d6b tempest-ProjectReaderTests-1268733534 None] Lock "cinder-bc94dc7a-cd0c-4d55-a9f1-0ff7241e1df6-delete_snapshot" released by "delete_snapshot" :: held 1.852s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-a00d250b-0539-404a-a2da-9592eae54106-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-a00d250b-0539-404a-a2da-9592eae54106-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-quobyte-a00d250b-0539-404a-a2da-9592eae54106" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:11 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] Creating offline snapshot b9de9c5a-544e-407b-8878-c7e2fbca5e57 of volume 327901d1-9be1-4da8-a89c-307c266f0516 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:46:11 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-a00d250b-0539-404a-a2da-9592eae54106" acquired by "delete_volume" :: waited 0.047s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:11 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[172679bd-c32f-41aa-aad9-d1607f838d8f]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:11 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2041afc5-caa3-4847-961a-d541e244f3ac]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:11 devstack sudo[110190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516 Aug 05 10:46:11 devstack sudo[110190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:11 devstack sudo[110191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106 Aug 05 10:46:11 devstack sudo[110191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:11 devstack sudo[110190]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516" returned: 0 in 0.418s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:11 devstack sudo[110201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57 1G Aug 05 10:46:11 devstack sudo[110201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:11 devstack sudo[110191]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106" returned: 0 in 0.444s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:11 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:11 devstack sudo[110203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106 Aug 05 10:46:11 devstack sudo[110203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:12 devstack sudo[110203]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-a00d250b-0539-404a-a2da-9592eae54106" returned: 0 in 0.295s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-a00d250b-0539-404a-a2da-9592eae54106" released by "delete_volume" :: held 0.826s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] Created reservations ['72885bbd-e4da-4646-abc3-ce0816bd0aed', 'f3efbeb6-8876-49e7-bea2-8a42a2bbbff0', '046dd67d-83c0-433c-9749-d7efe1ac3916', '264b909a-ecca-46b1-b416-5a69d5a6b6e8'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:12 devstack sudo[110201]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57 1G" returned: 0 in 0.453s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327901d1-9be1-4da8-a89c-307c266f0516 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:12 devstack sudo[110210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327901d1-9be1-4da8-a89c-307c266f0516 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57 Aug 05 10:46:12 devstack sudo[110210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:12 devstack sudo[110212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:46:12 devstack sudo[110212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:12 devstack sudo[110210]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:12 devstack sudo[110212]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327901d1-9be1-4da8-a89c-307c266f0516 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57" returned: 0 in 0.433s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:12 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57 is being set with open permissions: ugo+rw Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.391s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:46:12 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] Deleted volume successfully. Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-6c9f4fa4-597e-4e5b-a31a-3435ebd78983 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-a00d250b-0539-404a-a2da-9592eae54106-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:12 devstack sudo[110218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57 Aug 05 10:46:12 devstack sudo[110218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Flow 'volume_create_manager' (2d1f081c-147e-4c73-bba6-e598a06e764d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:12 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffcf2c5-822a-41e5-b04b-ca2c4ea43f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffcf2c5-822a-41e5-b04b-ca2c4ea43f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1443607751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d7d942-6427-43e8-bacc-a5270985cc20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b6b72465254f0ba50fcade3ef18a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:13Z,use_quota=True,user_id='6b7cd23726634c2ebad9f38a27db563b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80239cac-9d6b-49dd-a5af-ac1f081e71c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80239cac-9d6b-49dd-a5af-ac1f081e71c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f009646-c973-43a7-a5df-372ad4b69e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f009646-c973-43a7-a5df-372ad4b69e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d7d942-6427-43e8-bacc-a5270985cc20', 'volume_name': 'volume-d8d7d942-6427-43e8-bacc-a5270985cc20', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eac82e6-0b02-4dfa-9eea-d6f10a8fb622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eac82e6-0b02-4dfa-9eea-d6f10a8fb622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:13 devstack sudo[110218]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641d5290-efca-45f7-af20-943de578f9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:13 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Volume d8d7d942-6427-43e8-bacc-a5270985cc20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d7d942-6427-43e8-bacc-a5270985cc20', 'volume_size': 1} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57" returned: 0 in 0.314s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:13 devstack sudo[110221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.info Aug 05 10:46:13 devstack sudo[110221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:13 devstack sudo[110221]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.info" returned: 0 in 0.281s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:13 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.info is being set with open permissions: ugo+rw Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:13 devstack sudo[110225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.info Aug 05 10:46:13 devstack sudo[110225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:13 devstack sudo[110225]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.info" returned: 0 in 0.254s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.316s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.591s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1443607751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d7d942-6427-43e8-bacc-a5270985cc20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b6b72465254f0ba50fcade3ef18a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:13Z,use_quota=True,user_id='6b7cd23726634c2ebad9f38a27db563b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Creating volume d8d7d942-6427-43e8-bacc-a5270985cc20 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:46:13 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:13 devstack sudo[110228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20 1073741824 Aug 05 10:46:13 devstack sudo[110228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:13 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a1ffda41-334e-432d-a277-b3c4f55aa068 tempest-ProjectMemberTests-1104312187 None] Create snapshot completed successfully Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:13 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:13 devstack sudo[110232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:46:13 devstack sudo[110232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:14 devstack sudo[110228]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20 1073741824" returned: 0 in 0.541s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:14 devstack sudo[110232]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.316s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:14 devstack sudo[110237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20 Aug 05 10:46:14 devstack sudo[110237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-b9de9c5a-544e-407b-8878-c7e2fbca5e57-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-b9de9c5a-544e-407b-8878-c7e2fbca5e57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-327901d1-9be1-4da8-a89c-307c266f0516" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-327901d1-9be1-4da8-a89c-307c266f0516" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-b9de9c5a-544e-407b-8878-c7e2fbca5e57" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-b9de9c5a-544e-407b-8878-c7e2fbca5e57" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] Deleting offline snapshot b9de9c5a-544e-407b-8878-c7e2fbca5e57 of volume 327901d1-9be1-4da8-a89c-307c266f0516 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:46:14 devstack sudo[110237]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] snapshot_file for this snap is: volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20" returned: 0 in 0.305s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c87ece-730a-4a1b-a793-24474a00ade3]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641d5290-efca-45f7-af20-943de578f9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d7d942-6427-43e8-bacc-a5270985cc20', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e5489c-0238-4a0d-8fd6-62654473ab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:14 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Volume volume-d8d7d942-6427-43e8-bacc-a5270985cc20 (d8d7d942-6427-43e8-bacc-a5270985cc20): created successfully Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e5489c-0238-4a0d-8fd6-62654473ab51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:14 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Flow 'volume_create_manager' (2d1f081c-147e-4c73-bba6-e598a06e764d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:14 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-bd3c64d6-c805-4b25-a987-a34663b6cc51 tempest-ProjectReaderTests-1268733534 None] Created volume successfully. Aug 05 10:46:14 devstack sudo[110240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57 Aug 05 10:46:14 devstack sudo[110240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:15 devstack sudo[110240]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57" returned: 0 in 0.498s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-327901d1-9be1-4da8-a89c-307c266f0516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:46:15 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c472f1fb-f3e1-4383-be6a-1b6a8f1d2be0]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:15 devstack sudo[110247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516 Aug 05 10:46:15 devstack sudo[110247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:15 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] Creating offline snapshot 4bcd24ad-f62e-4761-94ed-060aa3cc800c of volume d8d7d942-6427-43e8-bacc-a5270985cc20 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:46:15 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f92a5d4-e4a0-4b0e-9508-717ad3ab054b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:15 devstack sudo[110249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20 Aug 05 10:46:15 devstack sudo[110249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:15 devstack sudo[110247]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516" returned: 0 in 0.481s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:15 devstack sudo[110254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57 Aug 05 10:46:15 devstack sudo[110254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:15 devstack sudo[110249]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20" returned: 0 in 0.444s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:15 devstack sudo[110263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c 1G Aug 05 10:46:15 devstack sudo[110263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:15 devstack sudo[110254]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57" returned: 0 in 0.387s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:15 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:16 devstack sudo[110265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57 Aug 05 10:46:16 devstack sudo[110265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:16 devstack sudo[110265]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516.b9de9c5a-544e-407b-8878-c7e2fbca5e57" returned: 0 in 0.266s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-b9de9c5a-544e-407b-8878-c7e2fbca5e57" released by "_delete_snapshot" :: held 1.764s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-327901d1-9be1-4da8-a89c-307c266f0516" released by "delete_snapshot" :: held 1.794s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:16 devstack sudo[110263]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c 1G" returned: 0 in 0.453s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d7d942-6427-43e8-bacc-a5270985cc20 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:16 devstack sudo[110273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d7d942-6427-43e8-bacc-a5270985cc20 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c Aug 05 10:46:16 devstack sudo[110273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:16 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] Created reservations ['8aa3b2b8-d086-4b50-a094-1e90988bd9ce', '635a5766-2796-4f66-92ae-3546314515d8', '5bae9444-fc21-4829-9765-1b39fc80d246', '9a7c49c3-3adc-4ba7-97af-3c76f79b226c'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:16 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] Delete snapshot completed successfully. Aug 05 10:46:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-99c8a317-cbf1-4e16-985c-43b19c23dd13 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-b9de9c5a-544e-407b-8878-c7e2fbca5e57-delete_snapshot" released by "delete_snapshot" :: held 1.980s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:16 devstack sudo[110273]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-327901d1-9be1-4da8-a89c-307c266f0516-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d7d942-6427-43e8-bacc-a5270985cc20 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c" returned: 0 in 0.336s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:16 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c is being set with open permissions: ugo+rw Aug 05 10:46:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:16 devstack sudo[110278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c Aug 05 10:46:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-327901d1-9be1-4da8-a89c-307c266f0516-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:16 devstack sudo[110278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-327901d1-9be1-4da8-a89c-307c266f0516" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:16 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-327901d1-9be1-4da8-a89c-307c266f0516" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:16 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d54b16-0bb2-4a20-b8bc-b86c3ff5acc5]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:16 devstack sudo[110280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516 Aug 05 10:46:16 devstack sudo[110278]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:16 devstack sudo[110280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c" returned: 0 in 0.296s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:16 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:17 devstack sudo[110283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.info Aug 05 10:46:17 devstack sudo[110283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:17 devstack sudo[110280]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516" returned: 0 in 0.396s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:17 devstack sudo[110289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516 Aug 05 10:46:17 devstack sudo[110289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:17 devstack sudo[110283]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.info" returned: 0 in 0.311s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:17 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.info is being set with open permissions: ugo+rw Aug 05 10:46:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:17 devstack sudo[110291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.info Aug 05 10:46:17 devstack sudo[110291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:17 devstack sudo[110289]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-327901d1-9be1-4da8-a89c-307c266f0516" returned: 0 in 0.285s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:17 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-327901d1-9be1-4da8-a89c-307c266f0516" released by "delete_volume" :: held 0.755s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:17 devstack sudo[110291]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.info" returned: 0 in 0.290s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.226s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:17 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] Created reservations ['d3ea4a6b-00fa-49e6-9248-fd710d550f38', 'f3d5fd71-1604-4fbf-bb64-bcef87f6f71f', 'd77c430b-2610-45d0-a0d7-3da0e481b8aa', '3f791cd5-cefb-463f-a312-1022e6ac05ac'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:17 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ae31abb6-3b07-47c2-809d-31ced7071ad2 tempest-ProjectReaderTests-1268733534 None] Create snapshot completed successfully Aug 05 10:46:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:17 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:17 devstack sudo[110295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:46:17 devstack sudo[110295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:17 devstack sudo[110295]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:17 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.264s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:17 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:46:17 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] Deleted volume successfully. Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-74ca9730-e289-451f-ac8b-da6e7d944c82 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-327901d1-9be1-4da8-a89c-307c266f0516-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (54fb8ecb-a9dc-4787-91f6-61d52a969dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2901f04e-b32a-4ea4-8af4-94820f64f94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2901f04e-b32a-4ea4-8af4-94820f64f94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1197730286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5032de36-0315-4b4d-b740-f6fa4b803600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:18Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60571bed-ae34-4ad8-ae9f-41bb91bf60a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60571bed-ae34-4ad8-ae9f-41bb91bf60a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f810dec-d0e8-43fa-a001-61c45a6cbdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f810dec-d0e8-43fa-a001-61c45a6cbdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5032de36-0315-4b4d-b740-f6fa4b803600', 'volume_name': 'volume-5032de36-0315-4b4d-b740-f6fa4b803600', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f597228-66c1-409e-b05f-a537fef301e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f597228-66c1-409e-b05f-a537fef301e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9f6447-6832-4363-9b8a-115632a4b767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:18 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Volume 5032de36-0315-4b4d-b740-f6fa4b803600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5032de36-0315-4b4d-b740-f6fa4b803600', 'volume_size': 1} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1197730286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5032de36-0315-4b4d-b740-f6fa4b803600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:18Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Creating volume 5032de36-0315-4b4d-b740-f6fa4b803600 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:46:18 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:18 devstack sudo[110298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600 1073741824 Aug 05 10:46:18 devstack sudo[110298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-4bcd24ad-f62e-4761-94ed-060aa3cc800c-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-4bcd24ad-f62e-4761-94ed-060aa3cc800c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-quobyte-d8d7d942-6427-43e8-bacc-a5270985cc20" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-d8d7d942-6427-43e8-bacc-a5270985cc20" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-quobyte-4bcd24ad-f62e-4761-94ed-060aa3cc800c" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-4bcd24ad-f62e-4761-94ed-060aa3cc800c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] Deleting offline snapshot 4bcd24ad-f62e-4761-94ed-060aa3cc800c of volume d8d7d942-6427-43e8-bacc-a5270985cc20 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] snapshot_file for this snap is: volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[13178683-6e42-4157-974c-193d8f6abfe4]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:18 devstack sudo[110303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c Aug 05 10:46:18 devstack sudo[110303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:18 devstack sudo[110298]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600 1073741824" returned: 0 in 0.448s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:18 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:18 devstack sudo[110305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600 Aug 05 10:46:18 devstack sudo[110305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:19 devstack sudo[110303]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c" returned: 0 in 0.374s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8d7d942-6427-43e8-bacc-a5270985cc20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[668f83ee-4b6d-4eb2-9ed6-5264a5191061]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:19 devstack sudo[110305]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600" returned: 0 in 0.259s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9f6447-6832-4363-9b8a-115632a4b767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5032de36-0315-4b4d-b740-f6fa4b803600', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed2b80bf-4bb6-40a5-aaf1-286e765b8ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:19 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Volume volume-5032de36-0315-4b4d-b740-f6fa4b803600 (5032de36-0315-4b4d-b740-f6fa4b803600): created successfully Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed2b80bf-4bb6-40a5-aaf1-286e765b8ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (54fb8ecb-a9dc-4787-91f6-61d52a969dd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:19 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-fe391803-f2f1-46c7-8c40-404c49178218 tempest-ProjectMemberTests-1104312187 None] Created volume successfully. Aug 05 10:46:19 devstack sudo[110311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20 Aug 05 10:46:19 devstack sudo[110311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:19 devstack sudo[110311]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20" returned: 0 in 0.399s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] Creating offline snapshot 48981952-a17c-4903-bba6-2a0b5f4fdbb4 of volume 5032de36-0315-4b4d-b740-f6fa4b803600 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:46:19 devstack sudo[110316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c Aug 05 10:46:19 devstack sudo[110316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a749d0-dc88-4825-a2b2-9a1faea0d34d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:19 devstack sudo[110318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600 Aug 05 10:46:19 devstack sudo[110318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:19 devstack sudo[110316]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c" returned: 0 in 0.340s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:19 devstack sudo[110325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c Aug 05 10:46:19 devstack sudo[110325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:19 devstack sudo[110318]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600" returned: 0 in 0.375s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:19 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:19 devstack sudo[110329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4 1G Aug 05 10:46:19 devstack sudo[110329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:20 devstack sudo[110325]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20.4bcd24ad-f62e-4761-94ed-060aa3cc800c" returned: 0 in 0.258s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:20 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-4bcd24ad-f62e-4761-94ed-060aa3cc800c" released by "_delete_snapshot" :: held 1.454s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:20 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-d8d7d942-6427-43e8-bacc-a5270985cc20" released by "delete_snapshot" :: held 1.476s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:20 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] Created reservations ['1c3e4c0a-4398-4a7b-9224-4afb874de519', '28e47215-e9b5-4712-9c44-23fb6b0da443', '45ed8e90-2578-473e-b3f7-d8bb0446a02b', 'e3f720f0-5342-4313-adf0-540cbfe9dd5b'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:20 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] Delete snapshot completed successfully. Aug 05 10:46:20 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-a1f4de36-eb19-44a2-90ac-531de2728753 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-4bcd24ad-f62e-4761-94ed-060aa3cc800c-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:20 devstack sudo[110329]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4 1G" returned: 0 in 0.427s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5032de36-0315-4b4d-b740-f6fa4b803600 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:20 devstack sudo[110335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5032de36-0315-4b4d-b740-f6fa4b803600 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4 Aug 05 10:46:20 devstack sudo[110335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:20 devstack sudo[110335]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5032de36-0315-4b4d-b740-f6fa4b803600 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4" returned: 0 in 0.285s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:20 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4 is being set with open permissions: ugo+rw Aug 05 10:46:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:20 devstack sudo[110340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4 Aug 05 10:46:20 devstack sudo[110340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:20 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-d8d7d942-6427-43e8-bacc-a5270985cc20-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:20 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-d8d7d942-6427-43e8-bacc-a5270985cc20-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:20 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-quobyte-d8d7d942-6427-43e8-bacc-a5270985cc20" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:20 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-d8d7d942-6427-43e8-bacc-a5270985cc20" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:20 devstack sudo[110340]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4" returned: 0 in 0.263s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:20 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac18c136-1d19-4995-975b-696310f9dfa2]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:20 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:20 devstack sudo[110345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.info Aug 05 10:46:20 devstack sudo[110345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:20 devstack sudo[110344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20 Aug 05 10:46:20 devstack sudo[110344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:21 devstack sudo[110345]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.info" returned: 0 in 0.268s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:21 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.info is being set with open permissions: ugo+rw Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:21 devstack sudo[110351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.info Aug 05 10:46:21 devstack sudo[110351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:21 devstack sudo[110344]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20" returned: 0 in 0.378s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:21 devstack sudo[110354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20 Aug 05 10:46:21 devstack sudo[110354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:21 devstack sudo[110351]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.info" returned: 0 in 0.240s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.965s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:21 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7c7fa95c-3b84-474d-811d-4aeee6db9d8a tempest-ProjectMemberTests-1104312187 None] Create snapshot completed successfully Aug 05 10:46:21 devstack sudo[110354]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-d8d7d942-6427-43e8-bacc-a5270985cc20" returned: 0 in 0.258s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-d8d7d942-6427-43e8-bacc-a5270985cc20" released by "delete_volume" :: held 0.696s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] Created reservations ['55930a7c-684a-47b4-ba42-50ff700d2144', '56e063f0-e539-4c74-91f3-e7a3a0329ada', '6da21a01-68b1-4120-a33d-6d2d1fd9e1d0', 'e975cd50-c7a9-413d-8575-a711a495f872'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-48981952-a17c-4903-bba6-2a0b5f4fdbb4-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-48981952-a17c-4903-bba6-2a0b5f4fdbb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-5032de36-0315-4b4d-b740-f6fa4b803600" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-5032de36-0315-4b4d-b740-f6fa4b803600" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-48981952-a17c-4903-bba6-2a0b5f4fdbb4" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-48981952-a17c-4903-bba6-2a0b5f4fdbb4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] Deleting offline snapshot 48981952-a17c-4903-bba6-2a0b5f4fdbb4 of volume 5032de36-0315-4b4d-b740-f6fa4b803600 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] snapshot_file for this snap is: volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[915d4d45-3354-4511-9a01-87bcf7d885a5]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:21 devstack sudo[110358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:46:21 devstack sudo[110358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:21 devstack sudo[110359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4 Aug 05 10:46:21 devstack sudo[110359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:21 devstack sudo[110358]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.249s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:46:21 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] Deleted volume successfully. Aug 05 10:46:21 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-19fb99cd-55fe-4488-9975-f2e6d18d25d3 tempest-ProjectReaderTests-1268733534 None] Lock "cinder-d8d7d942-6427-43e8-bacc-a5270985cc20-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:22 devstack sudo[110359]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4" returned: 0 in 0.375s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5032de36-0315-4b4d-b740-f6fa4b803600(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd518e2e-be22-439a-98b1-2d6b6160658a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:22 devstack sudo[110367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600 Aug 05 10:46:22 devstack sudo[110367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Flow 'volume_create_manager' (1c50e3f1-6723-4a67-a24d-1c783d8d8a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7acab772-6fc0-4cc2-809e-65f009379abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7acab772-6fc0-4cc2-809e-65f009379abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1173585815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6688b9fa-3be8-4236-91a7-5a7da0552726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b6b72465254f0ba50fcade3ef18a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:22Z,use_quota=True,user_id='6b7cd23726634c2ebad9f38a27db563b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974c806a-d055-439a-8408-14f5bddb15e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974c806a-d055-439a-8408-14f5bddb15e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb078aee-e5b6-4891-9317-993fefcb06a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb078aee-e5b6-4891-9317-993fefcb06a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6688b9fa-3be8-4236-91a7-5a7da0552726', 'volume_name': 'volume-6688b9fa-3be8-4236-91a7-5a7da0552726', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a0f6e8-e024-4da0-ba48-178674aeea55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a0f6e8-e024-4da0-ba48-178674aeea55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18cb4ab3-f541-490f-8c60-89ef877c9f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:22 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Volume 6688b9fa-3be8-4236-91a7-5a7da0552726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6688b9fa-3be8-4236-91a7-5a7da0552726', 'volume_size': 1} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1173585815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6688b9fa-3be8-4236-91a7-5a7da0552726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b6b72465254f0ba50fcade3ef18a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:22Z,use_quota=True,user_id='6b7cd23726634c2ebad9f38a27db563b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Creating volume 6688b9fa-3be8-4236-91a7-5a7da0552726 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:46:22 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:22 devstack sudo[110367]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600" returned: 0 in 0.368s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:22 devstack sudo[110372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726 1073741824 Aug 05 10:46:22 devstack sudo[110372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:22 devstack sudo[110373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4 Aug 05 10:46:22 devstack sudo[110373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:22 devstack sudo[110373]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4" returned: 0 in 0.338s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:22 devstack sudo[110382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4 Aug 05 10:46:22 devstack sudo[110382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:22 devstack sudo[110372]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726 1073741824" returned: 0 in 0.431s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:22 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:22 devstack sudo[110384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726 Aug 05 10:46:22 devstack sudo[110384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:23 devstack sudo[110382]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600.48981952-a17c-4903-bba6-2a0b5f4fdbb4" returned: 0 in 0.253s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-48981952-a17c-4903-bba6-2a0b5f4fdbb4" released by "_delete_snapshot" :: held 1.442s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-5032de36-0315-4b4d-b740-f6fa4b803600" released by "delete_snapshot" :: held 1.467s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] Created reservations ['5679bd89-8b1b-4c6d-b78c-1f809f24d5d6', 'edafdb83-007f-4eb6-997f-20202e758624', '36745831-9001-4bc6-8266-09d20db4e2b6', '72003d34-66fa-48ae-a75c-86aa6be6f4b8'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:23 devstack sudo[110384]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726" returned: 0 in 0.268s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18cb4ab3-f541-490f-8c60-89ef877c9f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6688b9fa-3be8-4236-91a7-5a7da0552726', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9ed8b7-b8b0-41e7-90f3-f1d966de8bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:23 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Volume volume-6688b9fa-3be8-4236-91a7-5a7da0552726 (6688b9fa-3be8-4236-91a7-5a7da0552726): created successfully Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9ed8b7-b8b0-41e7-90f3-f1d966de8bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Flow 'volume_create_manager' (1c50e3f1-6723-4a67-a24d-1c783d8d8a07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:23 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] Delete snapshot completed successfully. Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-d19261b0-3004-4ef4-b665-629b036b0e6e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-48981952-a17c-4903-bba6-2a0b5f4fdbb4-delete_snapshot" released by "delete_snapshot" :: held 1.644s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:23 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b0270fda-6e4f-4c6b-a889-edb354d0357a tempest-ProjectReaderTests-1268733534 None] Created volume successfully. Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] Creating offline snapshot 09d8fff7-7622-4980-8a92-d4e257ae64fc of volume 6688b9fa-3be8-4236-91a7-5a7da0552726 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8935de8e-bfa9-40aa-9831-4a2a99065b26]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:23 devstack sudo[110388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726 Aug 05 10:46:23 devstack sudo[110388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-5032de36-0315-4b4d-b740-f6fa4b803600-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-5032de36-0315-4b4d-b740-f6fa4b803600-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-5032de36-0315-4b4d-b740-f6fa4b803600" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-5032de36-0315-4b4d-b740-f6fa4b803600" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[539dcd0b-7d43-4e5d-b39d-588a30649a4a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:23 devstack sudo[110388]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726" returned: 0 in 0.365s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:23 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:23 devstack sudo[110394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc 1G Aug 05 10:46:23 devstack sudo[110394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:23 devstack sudo[110392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600 Aug 05 10:46:23 devstack sudo[110392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:24 devstack sudo[110392]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600" returned: 0 in 0.356s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:24 devstack sudo[110403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600 Aug 05 10:46:24 devstack sudo[110403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:24 devstack sudo[110394]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc 1G" returned: 0 in 0.401s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688b9fa-3be8-4236-91a7-5a7da0552726 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:24 devstack sudo[110405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688b9fa-3be8-4236-91a7-5a7da0552726 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc Aug 05 10:46:24 devstack sudo[110405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:24 devstack sudo[110403]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-5032de36-0315-4b4d-b740-f6fa4b803600" returned: 0 in 0.246s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-5032de36-0315-4b4d-b740-f6fa4b803600" released by "delete_volume" :: held 0.661s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] Created reservations ['3c886404-d89b-432f-9eee-35b164d08adb', 'e8838cd8-65c3-4206-bb67-79eb78d5a0e6', '81f0b557-09ff-4b11-a051-aa396bd7e083', 'c4472dd7-b685-4fb4-a2e0-0ebca1d0b216'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:24 devstack sudo[110405]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688b9fa-3be8-4236-91a7-5a7da0552726 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc" returned: 0 in 0.314s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:24 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc is being set with open permissions: ugo+rw Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:24 devstack sudo[110411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:46:24 devstack sudo[110411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:24 devstack sudo[110412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc Aug 05 10:46:24 devstack sudo[110412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:24 devstack sudo[110412]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:24 devstack sudo[110411]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc" returned: 0 in 0.239s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.254s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:46:24 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] Deleted volume successfully. Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:24 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-639aca54-1ef5-4d30-979b-4a4ee5540747 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-5032de36-0315-4b4d-b740-f6fa4b803600-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:24 devstack sudo[110417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.info Aug 05 10:46:24 devstack sudo[110417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:25 devstack sudo[110417]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.info" returned: 0 in 0.275s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:25 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.info is being set with open permissions: ugo+rw Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:25 devstack sudo[110420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.info Aug 05 10:46:25 devstack sudo[110420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (e8dd180e-69c5-4860-8cf4-09c74260f344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb1ec4d-a9bb-4a51-b145-8a56ac1a9980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:25 devstack sudo[110420]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb1ec4d-a9bb-4a51-b145-8a56ac1a9980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2097077068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6709d4cc-6907-485d-b81a-37281d29d77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:25Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a69fe7-a1af-498a-9884-a7171ea330dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a69fe7-a1af-498a-9884-a7171ea330dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928b59de-e91a-48ff-ae6f-cd4919fe0376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928b59de-e91a-48ff-ae6f-cd4919fe0376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6709d4cc-6907-485d-b81a-37281d29d77c', 'volume_name': 'volume-6709d4cc-6907-485d-b81a-37281d29d77c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c76de4-f374-4c66-a8a1-c18857c7e8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c76de4-f374-4c66-a8a1-c18857c7e8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b488c69-8760-4b4d-95e2-0249f35aedea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:25 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Volume 6709d4cc-6907-485d-b81a-37281d29d77c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6709d4cc-6907-485d-b81a-37281d29d77c', 'volume_size': 1} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.info" returned: 0 in 0.293s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2097077068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6709d4cc-6907-485d-b81a-37281d29d77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:25Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Creating volume 6709d4cc-6907-485d-b81a-37281d29d77c {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:46:25 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:25 devstack sudo[110423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c 1073741824 Aug 05 10:46:25 devstack sudo[110423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:25 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-bee77b37-79c9-4a18-ac8a-ec37412fc61b tempest-ProjectReaderTests-1268733534 None] Create snapshot completed successfully Aug 05 10:46:25 devstack sudo[110423]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c 1073741824" returned: 0 in 0.404s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:25 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:25 devstack sudo[110429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c Aug 05 10:46:25 devstack sudo[110429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:26 devstack sudo[110429]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c" returned: 0 in 0.243s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b488c69-8760-4b4d-95e2-0249f35aedea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6709d4cc-6907-485d-b81a-37281d29d77c', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c316c8-983f-43f4-b78e-2801b6020d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:26 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Volume volume-6709d4cc-6907-485d-b81a-37281d29d77c (6709d4cc-6907-485d-b81a-37281d29d77c): created successfully Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c316c8-983f-43f4-b78e-2801b6020d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (e8dd180e-69c5-4860-8cf4-09c74260f344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:26 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-a20573b1-986c-4dd8-ac4f-07d31436760f tempest-ProjectMemberTests-1104312187 None] Created volume successfully. Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] Creating offline snapshot 02b5205f-c736-4bdc-885b-6c39ef54e6a2 of volume 6709d4cc-6907-485d-b81a-37281d29d77c {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edc1a30-2579-43d8-91ee-34ce4db90da1]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:26 devstack sudo[110432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c Aug 05 10:46:26 devstack sudo[110432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-09d8fff7-7622-4980-8a92-d4e257ae64fc-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] Lock "cinder-09d8fff7-7622-4980-8a92-d4e257ae64fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-quobyte-6688b9fa-3be8-4236-91a7-5a7da0552726" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-6688b9fa-3be8-4236-91a7-5a7da0552726" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-quobyte-09d8fff7-7622-4980-8a92-d4e257ae64fc" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-09d8fff7-7622-4980-8a92-d4e257ae64fc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] Deleting offline snapshot 09d8fff7-7622-4980-8a92-d4e257ae64fc of volume 6688b9fa-3be8-4236-91a7-5a7da0552726 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] snapshot_file for this snap is: volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4520854-6732-47f8-ace3-1ebf54bc8e6c]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:26 devstack sudo[110434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc Aug 05 10:46:26 devstack sudo[110434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:26 devstack sudo[110432]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c" returned: 0 in 0.379s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:26 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:26 devstack sudo[110440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2 1G Aug 05 10:46:26 devstack sudo[110440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:27 devstack sudo[110434]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc" returned: 0 in 0.386s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:27 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6688b9fa-3be8-4236-91a7-5a7da0552726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:46:27 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f46c6cb-9c20-4671-8e4e-a0e70111c37a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:27 devstack sudo[110447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726 Aug 05 10:46:27 devstack sudo[110447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:27 devstack sudo[110440]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2 1G" returned: 0 in 0.438s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6709d4cc-6907-485d-b81a-37281d29d77c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:27 devstack sudo[110451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6709d4cc-6907-485d-b81a-37281d29d77c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2 Aug 05 10:46:27 devstack sudo[110451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:27 devstack sudo[110447]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726" returned: 0 in 0.388s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:27 devstack sudo[110456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc Aug 05 10:46:27 devstack sudo[110456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:27 devstack sudo[110451]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6709d4cc-6907-485d-b81a-37281d29d77c -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2" returned: 0 in 0.307s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:27 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2 is being set with open permissions: ugo+rw Aug 05 10:46:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:27 devstack sudo[110461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2 Aug 05 10:46:27 devstack sudo[110461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:27 devstack sudo[110456]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc" returned: 0 in 0.337s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:27 devstack sudo[110461]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2" returned: 0 in 0.249s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:27 devstack sudo[110467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc Aug 05 10:46:27 devstack sudo[110467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:27 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:27 devstack sudo[110469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.info Aug 05 10:46:27 devstack sudo[110469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:28 devstack sudo[110467]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726.09d8fff7-7622-4980-8a92-d4e257ae64fc" returned: 0 in 0.249s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-09d8fff7-7622-4980-8a92-d4e257ae64fc" released by "_delete_snapshot" :: held 1.452s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-6688b9fa-3be8-4236-91a7-5a7da0552726" released by "delete_snapshot" :: held 1.474s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:28 devstack sudo[110469]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.info" returned: 0 in 0.303s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:28 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.info is being set with open permissions: ugo+rw Aug 05 10:46:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:28 devstack sudo[110473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.info Aug 05 10:46:28 devstack sudo[110473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:28 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] Created reservations ['1f574e20-1c8c-4e2c-abae-a93da6f39bab', '9ba7d03b-f40f-4d6f-9910-31fde6eb6090', '68a041ef-92ad-4886-8c1a-a5c0df4980f0', '1eecb9be-0d93-406e-b33a-1e7c9d64c8ef'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:28 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] Delete snapshot completed successfully. Aug 05 10:46:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-451ccc20-4a2d-4c98-ba78-0209c01916ac tempest-ProjectReaderTests-1268733534 None] Lock "cinder-09d8fff7-7622-4980-8a92-d4e257ae64fc-delete_snapshot" released by "delete_snapshot" :: held 1.670s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:28 devstack sudo[110473]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.info" returned: 0 in 0.250s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:28 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-c46940e8-8a3a-48a1-b59c-c1e6e555feac tempest-ProjectMemberTests-1104312187 None] Create snapshot completed successfully Aug 05 10:46:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-6688b9fa-3be8-4236-91a7-5a7da0552726-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] Lock "cinder-6688b9fa-3be8-4236-91a7-5a7da0552726-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] Acquiring lock "cinder-quobyte-6688b9fa-3be8-4236-91a7-5a7da0552726" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:28 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-6688b9fa-3be8-4236-91a7-5a7da0552726" acquired by "delete_volume" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:28 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cea301-8c4a-4713-a3e8-ea838e8b8a99]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:28 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:29 devstack sudo[110476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726 Aug 05 10:46:29 devstack sudo[110476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:29 devstack sudo[110476]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726" returned: 0 in 0.351s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:29 devstack sudo[110482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726 Aug 05 10:46:29 devstack sudo[110482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:29 devstack sudo[110482]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6688b9fa-3be8-4236-91a7-5a7da0552726" returned: 0 in 0.247s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] Lock "cinder-quobyte-6688b9fa-3be8-4236-91a7-5a7da0552726" released by "delete_volume" :: held 0.649s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] Created reservations ['d416890c-db14-4916-b79e-b480a484d624', '25272b0a-33e0-45e9-b74d-bdab78981417', '26039e8d-02e5-427b-b842-24ee40a129be', 'bee151b7-7692-47c2-be05-57a46c4f6213'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-02b5205f-c736-4bdc-885b-6c39ef54e6a2-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:29 devstack sudo[110485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:46:29 devstack sudo[110485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] Lock "cinder-02b5205f-c736-4bdc-885b-6c39ef54e6a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-6709d4cc-6907-485d-b81a-37281d29d77c" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-6709d4cc-6907-485d-b81a-37281d29d77c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-02b5205f-c736-4bdc-885b-6c39ef54e6a2" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-02b5205f-c736-4bdc-885b-6c39ef54e6a2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] Deleting offline snapshot 02b5205f-c736-4bdc-885b-6c39ef54e6a2 of volume 6709d4cc-6907-485d-b81a-37281d29d77c {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] snapshot_file for this snap is: volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da6d741-3e7d-4610-b301-b83d7b2c8763]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:29 devstack sudo[110487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2 Aug 05 10:46:29 devstack sudo[110487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:29 devstack sudo[110485]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.255s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:46:29 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] Deleted volume successfully. Aug 05 10:46:29 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-8b9e1f36-faf4-4e8e-991b-56edb0a118fb tempest-ProjectReaderTests-1268733534 None] Lock "cinder-6688b9fa-3be8-4236-91a7-5a7da0552726-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:30 devstack sudo[110487]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2" returned: 0 in 0.411s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:30 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6709d4cc-6907-485d-b81a-37281d29d77c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:46:30 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0697b372-a112-446b-86f8-da5e20b04ad2]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:30 devstack sudo[110493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c Aug 05 10:46:30 devstack sudo[110493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:30 devstack sudo[110493]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c" returned: 0 in 0.370s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:30 devstack sudo[110498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2 Aug 05 10:46:30 devstack sudo[110498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:30 devstack sudo[110498]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2" returned: 0 in 0.358s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:30 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:31 devstack sudo[110504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2 Aug 05 10:46:31 devstack sudo[110504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:31 devstack sudo[110504]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c.02b5205f-c736-4bdc-885b-6c39ef54e6a2" returned: 0 in 0.269s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-02b5205f-c736-4bdc-885b-6c39ef54e6a2" released by "_delete_snapshot" :: held 1.502s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-6709d4cc-6907-485d-b81a-37281d29d77c" released by "delete_snapshot" :: held 1.524s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:31 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=224,cinder:INSERT=64,cinder:UPDATE=257,cinder:DELETE=15 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:46:31 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] Created reservations ['4eeadeb5-3944-4f7e-9cf8-37e98141875a', '2570d100-ca06-4229-a679-7f3335948aab', 'cdca57b9-0341-455a-b7da-73d529f785d1', '573802ae-890b-4caf-9e1a-5bcfed93dd10'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:31 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] Delete snapshot completed successfully. Aug 05 10:46:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-cc96c14d-7803-4d91-a273-0e30d3d324fb tempest-ProjectMemberTests-1104312187 None] Lock "cinder-02b5205f-c736-4bdc-885b-6c39ef54e6a2-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-6709d4cc-6907-485d-b81a-37281d29d77c-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-6709d4cc-6907-485d-b81a-37281d29d77c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-6709d4cc-6907-485d-b81a-37281d29d77c" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:31 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-6709d4cc-6907-485d-b81a-37281d29d77c" acquired by "delete_volume" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:31 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b070fc74-672a-4a30-9207-2549a7774de1]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:31 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:32 devstack sudo[110507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c Aug 05 10:46:32 devstack sudo[110507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:32 devstack sudo[110507]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c" returned: 0 in 0.376s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:32 devstack sudo[110512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c Aug 05 10:46:32 devstack sudo[110512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:32 devstack sudo[110512]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-6709d4cc-6907-485d-b81a-37281d29d77c" returned: 0 in 0.257s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:32 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-6709d4cc-6907-485d-b81a-37281d29d77c" released by "delete_volume" :: held 0.699s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:32 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] Created reservations ['77f25bb0-baa0-4d29-b18c-af32f1d854a1', '34956a3f-e777-4c42-ad9b-2093355fd808', '6a1179e7-dcf6-4c83-93fa-29eb71083dc7', '0a1e1d47-09c6-405b-bab2-fda6826aded4'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:32 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:INSERT=78,cinder:UPDATE=274,cinder:SELECT=190,cinder:DELETE=29 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:46:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:32 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:32 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:32 devstack sudo[110515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:46:32 devstack sudo[110515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:33 devstack sudo[110515]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.251s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:46:33 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] Deleted volume successfully. Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-68fce10e-ea0b-42ff-93cd-de8005d07260 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-6709d4cc-6907-485d-b81a-37281d29d77c-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (289f3153-475b-4a79-8bc7-cd47891989f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8aea646-6a88-4e33-9e47-f9685a256b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8aea646-6a88-4e33-9e47-f9685a256b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-722114360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520bb87c-ac70-45e7-96c9-59031d4ccf90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:33Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f7b207-76c9-444b-83f8-5f6c585ec2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f7b207-76c9-444b-83f8-5f6c585ec2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e9d6d6-c020-41e5-bb25-d4d64283b603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e9d6d6-c020-41e5-bb25-d4d64283b603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '520bb87c-ac70-45e7-96c9-59031d4ccf90', 'volume_name': 'volume-520bb87c-ac70-45e7-96c9-59031d4ccf90', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e66bdcd-6e39-4dd5-b45c-efa0c3ce7559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e66bdcd-6e39-4dd5-b45c-efa0c3ce7559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce70511-ca66-4546-bc84-3dba688cc98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:33 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Volume 520bb87c-ac70-45e7-96c9-59031d4ccf90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-520bb87c-ac70-45e7-96c9-59031d4ccf90', 'volume_size': 1} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-722114360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520bb87c-ac70-45e7-96c9-59031d4ccf90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:33Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Creating volume 520bb87c-ac70-45e7-96c9-59031d4ccf90 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:46:33 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:46:33 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:33 devstack sudo[110519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90 1073741824 Aug 05 10:46:33 devstack sudo[110519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:34 devstack sudo[110519]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90 1073741824" returned: 0 in 0.437s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:34 devstack sudo[110525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90 Aug 05 10:46:34 devstack sudo[110525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:34 devstack sudo[110525]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90" returned: 0 in 0.241s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:46:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce70511-ca66-4546-bc84-3dba688cc98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-520bb87c-ac70-45e7-96c9-59031d4ccf90', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d5c4485-28a4-4a03-afc7-0e59b7a267f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:34 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Volume volume-520bb87c-ac70-45e7-96c9-59031d4ccf90 (520bb87c-ac70-45e7-96c9-59031d4ccf90): created successfully Aug 05 10:46:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d5c4485-28a4-4a03-afc7-0e59b7a267f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:34 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (289f3153-475b-4a79-8bc7-cd47891989f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:34 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-56ce0d47-0abe-47a5-a46d-e23514bf97b3 tempest-ProjectMemberTests-1104312187 None] Created volume successfully. Aug 05 10:46:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:34 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] Creating offline snapshot 93ada1be-aebb-4b61-914b-db1852e04a7f of volume 520bb87c-ac70-45e7-96c9-59031d4ccf90 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:46:34 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb7df14-bf56-4867-ab1d-187ae4b5a397]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:34 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:34 devstack sudo[110528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90 Aug 05 10:46:34 devstack sudo[110528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:35 devstack sudo[110528]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90" returned: 0 in 0.377s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:35 devstack sudo[110533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f 1G Aug 05 10:46:35 devstack sudo[110533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:35 devstack sudo[110533]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f 1G" returned: 0 in 0.441s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-520bb87c-ac70-45e7-96c9-59031d4ccf90 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:35 devstack sudo[110539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-520bb87c-ac70-45e7-96c9-59031d4ccf90 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f Aug 05 10:46:35 devstack sudo[110539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:35 devstack sudo[110539]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-520bb87c-ac70-45e7-96c9-59031d4ccf90 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f" returned: 0 in 0.312s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:35 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f is being set with open permissions: ugo+rw Aug 05 10:46:35 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:35 devstack sudo[110545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f Aug 05 10:46:35 devstack sudo[110545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:36 devstack sudo[110545]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f" returned: 0 in 0.245s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:36 devstack sudo[110548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.info Aug 05 10:46:36 devstack sudo[110548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:36 devstack sudo[110548]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.info" returned: 0 in 0.248s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:36 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.info is being set with open permissions: ugo+rw Aug 05 10:46:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:36 devstack sudo[110553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.info Aug 05 10:46:36 devstack sudo[110553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:36 devstack sudo[110553]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.info" returned: 0 in 0.252s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:36 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e0d4611c-79d8-4aad-9de8-8b6c36c09de3 tempest-ProjectMemberTests-1104312187 None] Create snapshot completed successfully Aug 05 10:46:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-93ada1be-aebb-4b61-914b-db1852e04a7f-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] Lock "cinder-93ada1be-aebb-4b61-914b-db1852e04a7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-520bb87c-ac70-45e7-96c9-59031d4ccf90" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-520bb87c-ac70-45e7-96c9-59031d4ccf90" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-93ada1be-aebb-4b61-914b-db1852e04a7f" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:36 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-93ada1be-aebb-4b61-914b-db1852e04a7f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] Deleting offline snapshot 93ada1be-aebb-4b61-914b-db1852e04a7f of volume 520bb87c-ac70-45e7-96c9-59031d4ccf90 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:46:36 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] snapshot_file for this snap is: volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:46:36 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5dba85-ec35-4147-9f2d-ec5864ab2c88]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:36 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:37 devstack sudo[110592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f Aug 05 10:46:37 devstack sudo[110592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:37 devstack sudo[110592]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f" returned: 0 in 0.382s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:37 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-520bb87c-ac70-45e7-96c9-59031d4ccf90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:46:37 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4c08e3-ad08-4842-86e7-87ffa72364f2]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:37 devstack sudo[110597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90 Aug 05 10:46:37 devstack sudo[110597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:37 devstack sudo[110597]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90" returned: 0 in 0.385s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:37 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:37 devstack sudo[110602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f Aug 05 10:46:37 devstack sudo[110602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:38 devstack sudo[110602]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f" returned: 0 in 0.330s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:38 devstack sudo[110607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f Aug 05 10:46:38 devstack sudo[110607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:38 devstack sudo[110607]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:38 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90.93ada1be-aebb-4b61-914b-db1852e04a7f" returned: 0 in 0.242s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:38 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-93ada1be-aebb-4b61-914b-db1852e04a7f" released by "_delete_snapshot" :: held 1.440s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:38 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-520bb87c-ac70-45e7-96c9-59031d4ccf90" released by "delete_snapshot" :: held 1.463s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:38 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] Created reservations ['fb04c347-207a-4918-8a46-88856223bfe7', '57b2d8dd-c52f-49a7-b041-64d7087367b1', 'ffa2b143-4a41-4a96-b91e-8940568e0025', '5093fa6a-a7c8-45e4-a016-e6bccf89b88c'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:38 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] Delete snapshot completed successfully. Aug 05 10:46:38 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-2a93c21a-10ad-4c66-959e-9e742f5678da tempest-ProjectMemberTests-1104312187 None] Lock "cinder-93ada1be-aebb-4b61-914b-db1852e04a7f-delete_snapshot" released by "delete_snapshot" :: held 1.592s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:38 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-520bb87c-ac70-45e7-96c9-59031d4ccf90-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] Lock "cinder-520bb87c-ac70-45e7-96c9-59031d4ccf90-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-520bb87c-ac70-45e7-96c9-59031d4ccf90" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-520bb87c-ac70-45e7-96c9-59031d4ccf90" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:39 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[336ed57a-5110-464c-b401-9b27dbfb69ee]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:39 devstack sudo[110610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90 Aug 05 10:46:39 devstack sudo[110610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:39 devstack sudo[110610]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90" returned: 0 in 0.360s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:39 devstack sudo[110615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90 Aug 05 10:46:39 devstack sudo[110615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:39 devstack sudo[110615]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-520bb87c-ac70-45e7-96c9-59031d4ccf90" returned: 0 in 0.256s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:39 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-520bb87c-ac70-45e7-96c9-59031d4ccf90" released by "delete_volume" :: held 0.674s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:39 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] Created reservations ['8b282c1a-5d23-4bce-9c9d-2b40a3501d6d', '76b8dbe1-4b66-472c-bf58-1dab2d527046', 'a04c4b07-7045-4778-b929-9596bbbf2a41', 'd52a83ed-e5b5-4f6a-9de4-1504718c8507'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:39 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:39 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:39 devstack sudo[110618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:46:39 devstack sudo[110618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:40 devstack sudo[110618]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.272s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:46:40 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] Deleted volume successfully. Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e1336bde-6f24-46ed-a394-e34fd70a506c tempest-ProjectMemberTests-1104312187 None] Lock "cinder-520bb87c-ac70-45e7-96c9-59031d4ccf90-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (5ffe6573-8cf7-46fa-ac6f-27e637b88611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3a1ac3-62c9-433b-a49a-7ef13d28e536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3a1ac3-62c9-433b-a49a-7ef13d28e536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264079369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154b74f2-ad5e-40f7-abec-60a98581c0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:41Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeec5827-f81d-45a9-809c-0436e6733faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeec5827-f81d-45a9-809c-0436e6733faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480a8c86-4d06-49bb-8758-7d92f3183562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480a8c86-4d06-49bb-8758-7d92f3183562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '154b74f2-ad5e-40f7-abec-60a98581c0da', 'volume_name': 'volume-154b74f2-ad5e-40f7-abec-60a98581c0da', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f8bd9b-3844-440d-9fbb-b4af8a5b02ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f8bd9b-3844-440d-9fbb-b4af8a5b02ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010261cb-d505-4c5b-8ad1-0a3374aa59d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:40 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Volume 154b74f2-ad5e-40f7-abec-60a98581c0da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-154b74f2-ad5e-40f7-abec-60a98581c0da', 'volume_size': 1} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264079369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154b74f2-ad5e-40f7-abec-60a98581c0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:41Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Creating volume 154b74f2-ad5e-40f7-abec-60a98581c0da {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:46:40 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:46:40 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:40 devstack sudo[110622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da 1073741824 Aug 05 10:46:40 devstack sudo[110622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:41 devstack sudo[110622]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da 1073741824" returned: 0 in 0.480s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:41 devstack sudo[110629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da Aug 05 10:46:41 devstack sudo[110629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:41 devstack sudo[110629]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da" returned: 0 in 0.259s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:41 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:46:41 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010261cb-d505-4c5b-8ad1-0a3374aa59d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154b74f2-ad5e-40f7-abec-60a98581c0da', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5806b1-0158-4989-b9ea-7e22f14bc458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:41 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Volume volume-154b74f2-ad5e-40f7-abec-60a98581c0da (154b74f2-ad5e-40f7-abec-60a98581c0da): created successfully Aug 05 10:46:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5806b1-0158-4989-b9ea-7e22f14bc458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:41 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (5ffe6573-8cf7-46fa-ac6f-27e637b88611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:41 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-f9c77709-bd67-48cb-9c79-d75c52c65cad tempest-ProjectMemberTests-1104312187 None] Created volume successfully. Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Flow 'volume_create_manager' (09efa8d8-d133-47d9-b0b1-8531bb7252fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ebc720-a75d-4cda-a416-5358b6c7488a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ebc720-a75d-4cda-a416-5358b6c7488a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-517887382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d09bf0-47f7-4a0f-a289-45eebb176900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='370d93b6f65641c78976f0a32c888e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:43Z,use_quota=True,user_id='6afc818b0e2441e799f62f97eb5c5b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e6a041-3b90-4fea-89dc-2515c024a434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e6a041-3b90-4fea-89dc-2515c024a434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38879a06-38f1-446a-911b-d870fa2e9be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38879a06-38f1-446a-911b-d870fa2e9be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37d09bf0-47f7-4a0f-a289-45eebb176900', 'volume_name': 'volume-37d09bf0-47f7-4a0f-a289-45eebb176900', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e06531-708f-46a2-8b88-cc2d9081388b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e06531-708f-46a2-8b88-cc2d9081388b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2718de6f-082a-4f19-b965-23d07a2ca457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:42 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Volume 37d09bf0-47f7-4a0f-a289-45eebb176900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37d09bf0-47f7-4a0f-a289-45eebb176900', 'volume_size': 1} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-517887382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d09bf0-47f7-4a0f-a289-45eebb176900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='370d93b6f65641c78976f0a32c888e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:43Z,use_quota=True,user_id='6afc818b0e2441e799f62f97eb5c5b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Creating volume 37d09bf0-47f7-4a0f-a289-45eebb176900 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:46:42 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-37d09bf0-47f7-4a0f-a289-45eebb176900 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:42 devstack sudo[110632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-37d09bf0-47f7-4a0f-a289-45eebb176900 1073741824 Aug 05 10:46:42 devstack sudo[110632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:42 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:43 devstack sudo[110632]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-37d09bf0-47f7-4a0f-a289-45eebb176900 1073741824" returned: 0 in 0.414s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-37d09bf0-47f7-4a0f-a289-45eebb176900 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:43 devstack sudo[110638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-37d09bf0-47f7-4a0f-a289-45eebb176900 Aug 05 10:46:43 devstack sudo[110638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:43 devstack sudo[110638]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-37d09bf0-47f7-4a0f-a289-45eebb176900" returned: 0 in 0.245s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:46:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.656s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2718de6f-082a-4f19-b965-23d07a2ca457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37d09bf0-47f7-4a0f-a289-45eebb176900', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12aac510-8e48-4100-a4c1-718f61cf363a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:43 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] Creating offline snapshot 8508ed77-57f5-4923-b2b1-5087b12d0c5f of volume 154b74f2-ad5e-40f7-abec-60a98581c0da {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:46:43 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Volume volume-37d09bf0-47f7-4a0f-a289-45eebb176900 (37d09bf0-47f7-4a0f-a289-45eebb176900): created successfully Aug 05 10:46:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12aac510-8e48-4100-a4c1-718f61cf363a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:43 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Flow 'volume_create_manager' (09efa8d8-d133-47d9-b0b1-8531bb7252fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:43 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[490af5a7-c63c-454f-8cd1-f7d01f698368]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:43 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:43 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-aecc5288-2c05-4a4c-882f-a28fac61e620 tempest-ProjectReaderTests-1338375204 None] Created volume successfully. Aug 05 10:46:43 devstack sudo[110641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da Aug 05 10:46:43 devstack sudo[110641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:43 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] Acquiring lock "cinder-37d09bf0-47f7-4a0f-a289-45eebb176900-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:43 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] Lock "cinder-37d09bf0-47f7-4a0f-a289-45eebb176900-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:43 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] Acquiring lock "cinder-quobyte-37d09bf0-47f7-4a0f-a289-45eebb176900" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] Lock "cinder-quobyte-37d09bf0-47f7-4a0f-a289-45eebb176900" acquired by "delete_volume" :: waited 0.022s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7dd4a6-cb36-4c79-b322-40b3484d9cd2]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-37d09bf0-47f7-4a0f-a289-45eebb176900 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:44 devstack sudo[110641]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da" returned: 0 in 0.421s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:44 devstack sudo[110648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f 1G Aug 05 10:46:44 devstack sudo[110648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:44 devstack sudo[110647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-37d09bf0-47f7-4a0f-a289-45eebb176900 Aug 05 10:46:44 devstack sudo[110647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:44 devstack sudo[110647]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-37d09bf0-47f7-4a0f-a289-45eebb176900" returned: 0 in 0.391s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-37d09bf0-47f7-4a0f-a289-45eebb176900 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:44 devstack sudo[110648]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:44 devstack sudo[110657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-37d09bf0-47f7-4a0f-a289-45eebb176900 Aug 05 10:46:44 devstack sudo[110657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f 1G" returned: 0 in 0.407s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-154b74f2-ad5e-40f7-abec-60a98581c0da -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:44 devstack sudo[110659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-154b74f2-ad5e-40f7-abec-60a98581c0da -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f Aug 05 10:46:44 devstack sudo[110659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:44 devstack sudo[110657]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-37d09bf0-47f7-4a0f-a289-45eebb176900" returned: 0 in 0.257s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] Lock "cinder-quobyte-37d09bf0-47f7-4a0f-a289-45eebb176900" released by "delete_volume" :: held 0.693s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] Created reservations ['66cfc49e-6520-4a45-a647-7ab293e3ca60', '4fee74b2-37c0-4c9d-8af0-3d341676c62e', 'e8e900f2-e952-481a-8015-b9c9cd9c2146', '64ea62fc-5132-45be-9a09-86d5faabafa2'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:44 devstack sudo[110659]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-154b74f2-ad5e-40f7-abec-60a98581c0da -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f" returned: 0 in 0.309s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:44 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f is being set with open permissions: ugo+rw Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:44 devstack sudo[110671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f Aug 05 10:46:44 devstack sudo[110671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:44 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:44 devstack sudo[110673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:46:44 devstack sudo[110673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:45 devstack sudo[110671]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f" returned: 0 in 0.275s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:45 devstack sudo[110677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.info Aug 05 10:46:45 devstack sudo[110677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:45 devstack sudo[110673]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.277s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:46:45 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] Deleted volume successfully. Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-64e5c8b0-2dc5-4f9f-ac15-e1d3d7b64a82 tempest-ProjectReaderTests-1338375204 None] Lock "cinder-37d09bf0-47f7-4a0f-a289-45eebb176900-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:45 devstack sudo[110677]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.info" returned: 0 in 0.263s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:45 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.info is being set with open permissions: ugo+rw Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:45 devstack sudo[110680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.info Aug 05 10:46:45 devstack sudo[110680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Flow 'volume_create_manager' (055f95e5-58ed-4bef-ba75-355ae61e3767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8c141e-1859-482c-9140-2c73b4c35db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:45 devstack sudo[110680]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8c141e-1859-482c-9140-2c73b4c35db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784968467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060ddfa6-7102-455d-aff0-1d8e17cd50c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='370d93b6f65641c78976f0a32c888e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:46Z,use_quota=True,user_id='6afc818b0e2441e799f62f97eb5c5b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79fd6efa-cc25-4176-8897-ff25658ec309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79fd6efa-cc25-4176-8897-ff25658ec309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e58e60-201d-4a9b-bb29-49816d3c74d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e58e60-201d-4a9b-bb29-49816d3c74d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '060ddfa6-7102-455d-aff0-1d8e17cd50c5', 'volume_name': 'volume-060ddfa6-7102-455d-aff0-1d8e17cd50c5', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86df543-fd7d-424c-b4b8-1e2cf635fa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86df543-fd7d-424c-b4b8-1e2cf635fa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6d05c7-1ec8-4618-ad19-2f644b2da32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:45 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Volume 060ddfa6-7102-455d-aff0-1d8e17cd50c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-060ddfa6-7102-455d-aff0-1d8e17cd50c5', 'volume_size': 1} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.info" returned: 0 in 0.301s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.081s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784968467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060ddfa6-7102-455d-aff0-1d8e17cd50c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='370d93b6f65641c78976f0a32c888e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:46Z,use_quota=True,user_id='6afc818b0e2441e799f62f97eb5c5b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Creating volume 060ddfa6-7102-455d-aff0-1d8e17cd50c5 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:46:45 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:46:45 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-060ddfa6-7102-455d-aff0-1d8e17cd50c5 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:45 devstack sudo[110683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-060ddfa6-7102-455d-aff0-1d8e17cd50c5 1073741824 Aug 05 10:46:45 devstack sudo[110683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:45 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-1234c700-bf8b-4e20-be87-882d14e6a4e1 tempest-ProjectMemberTests-1104312187 None] Create snapshot completed successfully Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-8508ed77-57f5-4923-b2b1-5087b12d0c5f-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-8508ed77-57f5-4923-b2b1-5087b12d0c5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-154b74f2-ad5e-40f7-abec-60a98581c0da" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:46 devstack sudo[110683]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-060ddfa6-7102-455d-aff0-1d8e17cd50c5 1073741824" returned: 0 in 0.457s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-154b74f2-ad5e-40f7-abec-60a98581c0da" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-8508ed77-57f5-4923-b2b1-5087b12d0c5f" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-8508ed77-57f5-4923-b2b1-5087b12d0c5f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] Deleting offline snapshot 8508ed77-57f5-4923-b2b1-5087b12d0c5f of volume 154b74f2-ad5e-40f7-abec-60a98581c0da {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] snapshot_file for this snap is: volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[112fe114-d124-4bab-a20c-1d9d5a03ae5a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-060ddfa6-7102-455d-aff0-1d8e17cd50c5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:46 devstack sudo[110691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-060ddfa6-7102-455d-aff0-1d8e17cd50c5 Aug 05 10:46:46 devstack sudo[110691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:46 devstack sudo[110690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f Aug 05 10:46:46 devstack sudo[110690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:46 devstack sudo[110691]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-060ddfa6-7102-455d-aff0-1d8e17cd50c5" returned: 0 in 0.249s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6d05c7-1ec8-4618-ad19-2f644b2da32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-060ddfa6-7102-455d-aff0-1d8e17cd50c5', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd23d90d-8263-4fae-85cf-f3bd16861c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:46 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Volume volume-060ddfa6-7102-455d-aff0-1d8e17cd50c5 (060ddfa6-7102-455d-aff0-1d8e17cd50c5): created successfully Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd23d90d-8263-4fae-85cf-f3bd16861c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Flow 'volume_create_manager' (055f95e5-58ed-4bef-ba75-355ae61e3767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:46 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-df744d5d-d98b-41ea-8797-b58e30e59b45 tempest-ProjectReaderTests-1338375204 None] Created volume successfully. Aug 05 10:46:46 devstack sudo[110690]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f" returned: 0 in 0.374s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-154b74f2-ad5e-40f7-abec-60a98581c0da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[536f0314-7ad7-4075-a997-58af84035655]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:46 devstack sudo[110698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da Aug 05 10:46:46 devstack sudo[110698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:46 devstack sudo[110698]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da" returned: 0 in 0.347s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:46 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:46 devstack sudo[110703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f Aug 05 10:46:46 devstack sudo[110703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:47 devstack sudo[110703]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f" returned: 0 in 0.331s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:47 devstack sudo[110709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f Aug 05 10:46:47 devstack sudo[110709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:47 devstack sudo[110709]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da.8508ed77-57f5-4923-b2b1-5087b12d0c5f" returned: 0 in 0.249s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-8508ed77-57f5-4923-b2b1-5087b12d0c5f" released by "_delete_snapshot" :: held 1.401s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-154b74f2-ad5e-40f7-abec-60a98581c0da" released by "delete_snapshot" :: held 1.425s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:47 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] Created reservations ['e096598e-ddd6-4166-b3ba-e4c2eed270ba', 'f7c94b6c-c342-4dde-b80e-82dbdcc36b60', '5e880935-2d98-4ea9-b32a-1110cd5f14f9', 'b649d770-5c58-434b-b0e1-497f095373fb'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:47 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] Delete snapshot completed successfully. Aug 05 10:46:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] Acquiring lock "cinder-060ddfa6-7102-455d-aff0-1d8e17cd50c5-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-f7a0ef6e-3f4b-4d31-abdc-1cd615ab066e tempest-ProjectMemberTests-1104312187 None] Lock "cinder-8508ed77-57f5-4923-b2b1-5087b12d0c5f-delete_snapshot" released by "delete_snapshot" :: held 1.578s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] Lock "cinder-060ddfa6-7102-455d-aff0-1d8e17cd50c5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] Acquiring lock "cinder-quobyte-060ddfa6-7102-455d-aff0-1d8e17cd50c5" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:47 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] Lock "cinder-quobyte-060ddfa6-7102-455d-aff0-1d8e17cd50c5" acquired by "delete_volume" :: waited 0.013s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:47 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e448b45-42ef-48e6-bdbb-07271a56672f]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:47 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-060ddfa6-7102-455d-aff0-1d8e17cd50c5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:47 devstack sudo[110712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-060ddfa6-7102-455d-aff0-1d8e17cd50c5 Aug 05 10:46:47 devstack sudo[110712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:48 devstack sudo[110712]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-060ddfa6-7102-455d-aff0-1d8e17cd50c5" returned: 0 in 0.356s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-060ddfa6-7102-455d-aff0-1d8e17cd50c5 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:48 devstack sudo[110718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-060ddfa6-7102-455d-aff0-1d8e17cd50c5 Aug 05 10:46:48 devstack sudo[110718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-154b74f2-ad5e-40f7-abec-60a98581c0da-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-154b74f2-ad5e-40f7-abec-60a98581c0da-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-154b74f2-ad5e-40f7-abec-60a98581c0da" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-154b74f2-ad5e-40f7-abec-60a98581c0da" acquired by "delete_volume" :: waited 0.015s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d8630b-db4b-411d-ad1e-61df862b1a2c]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:48 devstack sudo[110718]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-060ddfa6-7102-455d-aff0-1d8e17cd50c5" returned: 0 in 0.267s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] Lock "cinder-quobyte-060ddfa6-7102-455d-aff0-1d8e17cd50c5" released by "delete_volume" :: held 0.670s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] Created reservations ['e5415d3b-500b-4f11-9a53-b9af7c4b0e78', '1f10a97b-0a35-412c-a10e-b3c518f916ef', '612a9bee-0591-43a1-b8e9-df15bb86bac8', '5b50ef37-76f4-451c-b49b-0175aa22b73d'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:48 devstack sudo[110721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da Aug 05 10:46:48 devstack sudo[110721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:48 devstack sudo[110723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:46:48 devstack sudo[110723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:48 devstack sudo[110721]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da" returned: 0 in 0.365s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:48 devstack sudo[110729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da Aug 05 10:46:48 devstack sudo[110729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:48 devstack sudo[110723]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.258s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:46:48 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] Deleted volume successfully. Aug 05 10:46:48 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-5d6f719f-b7f3-4f77-be2f-f1d0b7c2a9be tempest-ProjectReaderTests-1338375204 None] Lock "cinder-060ddfa6-7102-455d-aff0-1d8e17cd50c5-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:49 devstack sudo[110729]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-154b74f2-ad5e-40f7-abec-60a98581c0da" returned: 0 in 0.269s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-154b74f2-ad5e-40f7-abec-60a98581c0da" released by "delete_volume" :: held 0.697s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] Created reservations ['8bb3d66f-87f6-4077-ac67-af2881e59e00', '54f627f7-d567-4603-8aea-677bd928f950', 'dd60c0f2-4130-49ec-88eb-0b44e7ee28e7', '1a047384-3a80-4eeb-aa15-c39430e81db6'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:49 devstack sudo[110732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:46:49 devstack sudo[110732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:49 devstack sudo[110732]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.256s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:46:49 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] Deleted volume successfully. Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-ff804362-c8e9-4913-9528-0d0bd001e9c9 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-154b74f2-ad5e-40f7-abec-60a98581c0da-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (a79c8846-e0c7-42c5-a359-c79aa9178bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee4e171-58ca-48f4-80e9-ee1a5e41461a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee4e171-58ca-48f4-80e9-ee1a5e41461a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1844280903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:50Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d633f3-ff1f-4197-96f4-9d3e7ab59496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d633f3-ff1f-4197-96f4-9d3e7ab59496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc2ab49-8bfa-41d8-8659-f37e23d56914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc2ab49-8bfa-41d8-8659-f37e23d56914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3', 'volume_name': 'volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7528244-3d20-4f9e-99a7-4eb60d609050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7528244-3d20-4f9e-99a7-4eb60d609050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:49 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c32b0e4-d42d-42f4-a395-6fcbeda2204b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:50 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Volume 07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3', 'volume_size': 1} Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1844280903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:50Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Creating volume 07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:46:50 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:50 devstack sudo[110735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 1073741824 Aug 05 10:46:50 devstack sudo[110735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:50 devstack sudo[110735]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 1073741824" returned: 0 in 0.489s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:50 devstack sudo[110740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 Aug 05 10:46:50 devstack sudo[110740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:50 devstack sudo[110740]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3" returned: 0 in 0.246s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c32b0e4-d42d-42f4-a395-6fcbeda2204b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0463470-4ae9-4832-a067-1a687d74dbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:50 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Volume volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 (07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3): created successfully Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0463470-4ae9-4832-a067-1a687d74dbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:50 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (a79c8846-e0c7-42c5-a359-c79aa9178bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:50 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b0f54643-19aa-4f6d-800a-711733cc5255 tempest-ProjectMemberTests-1104312187 None] Created volume successfully. Aug 05 10:46:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:52 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] Creating offline snapshot e39ab861-0c27-4d20-bc86-8fa233fa2bb2 of volume 07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:46:52 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a18b3b-5381-4bad-85bf-c8ac61809dc7]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:52 devstack sudo[110744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 Aug 05 10:46:52 devstack sudo[110744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:52 devstack sudo[110744]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3" returned: 0 in 0.359s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:52 devstack sudo[110749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2 1G Aug 05 10:46:52 devstack sudo[110749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:52 devstack sudo[110749]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2 1G" returned: 0 in 0.380s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:52 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:52 devstack sudo[110754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2 Aug 05 10:46:52 devstack sudo[110754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:53 devstack sudo[110754]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2" returned: 0 in 0.284s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:53 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2 is being set with open permissions: ugo+rw Aug 05 10:46:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:53 devstack sudo[110759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2 Aug 05 10:46:53 devstack sudo[110759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:53 devstack sudo[110759]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2" returned: 0 in 0.241s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:53 devstack sudo[110762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.info Aug 05 10:46:53 devstack sudo[110762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:53 devstack sudo[110762]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.info" returned: 0 in 0.248s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:53 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.info is being set with open permissions: ugo+rw Aug 05 10:46:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:53 devstack sudo[110765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.info Aug 05 10:46:53 devstack sudo[110765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:53 devstack sudo[110765]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.info" returned: 0 in 0.236s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:53 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.825s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:53 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-67c1e6e5-8e0a-45b0-afc0-cdde08e1a938 tempest-ProjectMemberTests-1104312187 None] Create snapshot completed successfully Aug 05 10:46:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-e39ab861-0c27-4d20-bc86-8fa233fa2bb2-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] Lock "cinder-e39ab861-0c27-4d20-bc86-8fa233fa2bb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-e39ab861-0c27-4d20-bc86-8fa233fa2bb2" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:54 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-e39ab861-0c27-4d20-bc86-8fa233fa2bb2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] Deleting offline snapshot e39ab861-0c27-4d20-bc86-8fa233fa2bb2 of volume 07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:46:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] snapshot_file for this snap is: volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2 {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:46:54 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af5b64c-a5df-44e4-92ec-c6cd1ee6b8c6]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:54 devstack sudo[110768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2 Aug 05 10:46:54 devstack sudo[110768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:54 devstack sudo[110768]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2" returned: 0 in 0.349s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:54 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:46:54 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7776437e-4752-47ca-b286-c90b5857842a]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:54 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:54 devstack sudo[110773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 Aug 05 10:46:54 devstack sudo[110773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:55 devstack sudo[110773]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3" returned: 0 in 0.343s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:55 devstack sudo[110778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2 Aug 05 10:46:55 devstack sudo[110778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:55 devstack sudo[110778]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2" returned: 0 in 0.322s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:55 devstack sudo[110783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2 Aug 05 10:46:55 devstack sudo[110783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:55 devstack sudo[110783]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:55 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3.e39ab861-0c27-4d20-bc86-8fa233fa2bb2" returned: 0 in 0.237s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-e39ab861-0c27-4d20-bc86-8fa233fa2bb2" released by "_delete_snapshot" :: held 1.336s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3" released by "delete_snapshot" :: held 1.355s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:55 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] Created reservations ['259583c2-6f2e-4b02-93d1-86581c6ce443', 'd6c7645a-f159-46de-a442-0ef1be55c88e', '231a5db2-3895-4954-a2b2-73d7414f9b43', 'c821d24b-1bbb-423f-9b7d-f4a5405a712d'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:55 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] Delete snapshot completed successfully. Aug 05 10:46:55 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-16bc40eb-176a-4402-bfaa-de1e17119ada tempest-ProjectMemberTests-1104312187 None] Lock "cinder-e39ab861-0c27-4d20-bc86-8fa233fa2bb2-delete_snapshot" released by "delete_snapshot" :: held 1.484s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] Lock "cinder-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:46:56 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3" acquired by "delete_volume" :: waited 0.014s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:46:56 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[df90a274-8106-4da2-b712-8d8d48a0c506]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:56 devstack sudo[110786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 Aug 05 10:46:56 devstack sudo[110786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:56 devstack sudo[110786]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3" returned: 0 in 0.340s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:56 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:56 devstack sudo[110791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3 Aug 05 10:46:56 devstack sudo[110791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:57 devstack sudo[110791]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3" returned: 0 in 0.239s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3" released by "delete_volume" :: held 0.635s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:57 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] Created reservations ['e4e20174-e9fe-43a1-a412-c5557990a8ac', '7c78919f-87e6-4694-ab61-3abd0c8df61c', 'd762e2f8-2012-4c1a-b312-cace913e5e53', 'ac8b36fb-bfe1-4776-b6a1-ac335efa7ede'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:46:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:57 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:57 devstack sudo[110794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:46:57 devstack sudo[110794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:57 devstack sudo[110794]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:57 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.232s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:57 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:46:57 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] Deleted volume successfully. Aug 05 10:46:57 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-e97ef196-cfab-4a4b-aa4a-b15be3e9f06f tempest-ProjectMemberTests-1104312187 None] Lock "cinder-07d73502-ebeb-4ab0-bcdb-3d51f78dd9b3-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:46:57 devstack cinder-volume[88736]: DEBUG cinder.volume.flows.manager.create_volume [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 10:46:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (a2a2e527-c889-46a4-9b16-b356e825db2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:57 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4d7424-515b-45de-977b-e689e1160099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4d7424-515b-45de-977b-e689e1160099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-486314313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6f24f1-5648-4391-8a9f-8a8e471e8e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:58Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb16e332-34af-407d-9284-76dd7bf801cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb16e332-34af-407d-9284-76dd7bf801cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a966616-79e9-4b00-89ec-2c645e04c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a966616-79e9-4b00-89ec-2c645e04c200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed6f24f1-5648-4391-8a9f-8a8e471e8e0a', 'volume_name': 'volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d557656-4284-451c-8eb5-94703fa97b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d557656-4284-451c-8eb5-94703fa97b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac6d569-1bb1-4be2-a370-10dc92ae5f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:58 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Volume ed6f24f1-5648-4391-8a9f-8a8e471e8e0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a', 'volume_size': 1} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T08:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-486314313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6f24f1-5648-4391-8a9f-8a8e471e8e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9f622abf54c518c53367f48d37e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T08:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T08:46:58Z,use_quota=True,user_id='751e31bf5f1f4bf1b0db2914e8636f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e559df-80e8-4a86-8fd4-4d6ca4d25413),volume_type_id=03e559df-80e8-4a86-8fd4-4d6ca4d25413)}" {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Creating volume ed6f24f1-5648-4391-8a9f-8a8e471e8e0a {{(pid=88736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Selected osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 as target Quobyte volume. {{(pid=88736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 10:46:58 devstack cinder-volume[88736]: INFO cinder.volume.drivers.remotefs [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] casted to osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7 Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a 1073741824 {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:58 devstack sudo[110797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a 1073741824 Aug 05 10:46:58 devstack sudo[110797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:58 devstack sudo[110797]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a 1073741824" returned: 0 in 0.391s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:58 devstack sudo[110802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a Aug 05 10:46:58 devstack sudo[110802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:58 devstack sudo[110802]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a" returned: 0 in 0.235s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] <== create_volume: return (664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'} {{(pid=88736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac6d569-1bb1-4be2-a370-10dc92ae5f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a', 'volume_size': 1}' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e686090e-3dcb-4e24-8488-0c90aaff21af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 10:46:58 devstack cinder-volume[88736]: INFO cinder.volume.flows.manager.create_volume [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Volume volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a (ed6f24f1-5648-4391-8a9f-8a8e471e8e0a): created successfully Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e686090e-3dcb-4e24-8488-0c90aaff21af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88736) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 10:46:58 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Flow 'volume_create_manager' (a2a2e527-c889-46a4-9b16-b356e825db2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88736) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 10:46:58 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-279853c8-5f12-425c-a142-f0ad18769782 tempest-ProjectMemberTests-1104312187 None] Created volume successfully. Aug 05 10:46:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:46:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:46:59 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] Creating offline snapshot f0f07ef8-5efa-49a8-87ec-f11f1de3854b of volume ed6f24f1-5648-4391-8a9f-8a8e471e8e0a {{(pid=88736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 10:46:59 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a288d0-7f1c-498d-a8f1-20fba8f2af6b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:46:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:59 devstack sudo[110805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a Aug 05 10:46:59 devstack sudo[110805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:59 devstack sudo[110805]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a" returned: 0 in 0.340s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b 1G {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:59 devstack sudo[110810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b 1G Aug 05 10:46:59 devstack sudo[110810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:46:59 devstack sudo[110810]: pam_unix(sudo:session): session closed for user root Aug 05 10:46:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b 1G" returned: 0 in 0.371s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:46:59 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:46:59 devstack sudo[110816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b Aug 05 10:46:59 devstack sudo[110816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:47:00 devstack sudo[110816]: pam_unix(sudo:session): session closed for user root Aug 05 10:47:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a -F qcow2 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b" returned: 0 in 0.277s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:47:00 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b is being set with open permissions: ugo+rw Aug 05 10:47:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:47:00 devstack sudo[110821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b Aug 05 10:47:00 devstack sudo[110821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:47:00 devstack sudo[110821]: pam_unix(sudo:session): session closed for user root Aug 05 10:47:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b" returned: 0 in 0.227s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:47:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:47:00 devstack sudo[110824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.info Aug 05 10:47:00 devstack sudo[110824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:47:00 devstack sudo[110824]: pam_unix(sudo:session): session closed for user root Aug 05 10:47:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.info" returned: 0 in 0.243s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:47:00 devstack cinder-volume[88736]: WARNING cinder.volume.drivers.remotefs [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.info is being set with open permissions: ugo+rw Aug 05 10:47:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.info {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:47:00 devstack sudo[110827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.info Aug 05 10:47:00 devstack sudo[110827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:47:00 devstack sudo[110827]: pam_unix(sudo:session): session closed for user root Aug 05 10:47:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.info" returned: 0 in 0.229s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:47:00 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.767s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:47:00 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-b97614ba-2e1d-401f-b719-70977c01de35 tempest-ProjectMemberTests-1104312187 None] Create snapshot completed successfully Aug 05 10:47:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-f0f07ef8-5efa-49a8-87ec-f11f1de3854b-delete_snapshot" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:47:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-f0f07ef8-5efa-49a8-87ec-f11f1de3854b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:47:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a" by "delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:47:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:47:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-f0f07ef8-5efa-49a8-87ec-f11f1de3854b" by "_delete_snapshot" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:47:01 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-f0f07ef8-5efa-49a8-87ec-f11f1de3854b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:47:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] Deleting offline snapshot f0f07ef8-5efa-49a8-87ec-f11f1de3854b of volume ed6f24f1-5648-4391-8a9f-8a8e471e8e0a {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 10:47:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] snapshot_file for this snap is: volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b {{(pid=88736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 10:47:01 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cb9d4a-c950-41ad-aeb9-16a64718a58b]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:47:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:47:01 devstack sudo[110831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b Aug 05 10:47:01 devstack sudo[110831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:47:01 devstack sudo[110831]: pam_unix(sudo:session): session closed for user root Aug 05 10:47:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b" returned: 0 in 0.348s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:47:01 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.remotefs [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 10:47:01 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbf7b62-8033-4759-823d-db5f3faeb81d]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:47:01 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:47:01 devstack sudo[110836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a Aug 05 10:47:01 devstack sudo[110836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:47:02 devstack sudo[110836]: pam_unix(sudo:session): session closed for user root Aug 05 10:47:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a" returned: 0 in 0.348s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:47:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:47:02 devstack sudo[110841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b Aug 05 10:47:02 devstack sudo[110841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:47:02 devstack sudo[110841]: pam_unix(sudo:session): session closed for user root Aug 05 10:47:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b" returned: 0 in 0.315s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:47:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:47:02 devstack sudo[110847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b Aug 05 10:47:02 devstack sudo[110847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:47:02 devstack sudo[110847]: pam_unix(sudo:session): session closed for user root Aug 05 10:47:02 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a.f0f07ef8-5efa-49a8-87ec-f11f1de3854b" returned: 0 in 0.245s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:47:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-f0f07ef8-5efa-49a8-87ec-f11f1de3854b" released by "_delete_snapshot" :: held 1.335s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:47:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a" released by "delete_snapshot" :: held 1.358s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:47:02 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] Created reservations ['bbc69cd8-0a5c-4669-b708-af656fa31c7c', '22d4ac85-dd9b-429b-8ca8-747aeb6811be', '8a0f60b1-90e4-4c11-9e06-d70c1b0b006c', 'b4cdbb2f-f6c4-4e43-8bc2-d52857dc9537'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:47:02 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] Delete snapshot completed successfully. Aug 05 10:47:02 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-3960de42-7c65-4978-8b8a-e8e9facf3590 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-f0f07ef8-5efa-49a8-87ec-f11f1de3854b-delete_snapshot" released by "delete_snapshot" :: held 1.482s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:47:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a-delete_volume" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:47:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:47:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "cinder-quobyte-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a" by "delete_volume" {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 10:47:03 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a" acquired by "delete_volume" :: waited 0.017s {{(pid=88736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 10:47:03 devstack cinder-volume[88736]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d0bb61-92b4-4cdd-95df-23c9d07cc451]: (4, 'qcow2') {{(pid=90235) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 10:47:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:47:03 devstack sudo[110850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a Aug 05 10:47:03 devstack sudo[110850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:47:03 devstack sudo[110850]: pam_unix(sudo:session): session closed for user root Aug 05 10:47:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a" returned: 0 in 0.341s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:47:03 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:47:04 devstack sudo[110855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a Aug 05 10:47:04 devstack sudo[110855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:47:04 devstack sudo[110855]: pam_unix(sudo:session): session closed for user root Aug 05 10:47:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd/volume-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a" returned: 0 in 0.240s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:47:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-quobyte-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a" released by "delete_volume" :: held 0.633s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:47:04 devstack cinder-volume[88736]: DEBUG cinder.quota [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] Created reservations ['8a5a237b-b533-4a6c-996f-c1cea1ea3062', '6cac2652-431e-4a77-95d5-910e97b533be', 'f592855e-43b7-42c3-961b-a35a9d2e8adb', 'd273ca44-3351-48cf-b2b5-38ad4ce29e56'] {{(pid=88736) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 10:47:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 10:47:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 10:47:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7': None} {{(pid=88736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 10:47:04 devstack cinder-volume[88736]: DEBUG cinder.volume.drivers.quobyte [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbd4823d-25ce-472b-afd4-164a3c71b3a7'] {{(pid=88736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 10:47:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.lockutils [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 10:47:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 10:47:04 devstack sudo[110858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd Aug 05 10:47:04 devstack sudo[110858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 10:47:04 devstack sudo[110858]: pam_unix(sudo:session): session closed for user root Aug 05 10:47:04 devstack cinder-volume[88736]: DEBUG oslo_concurrency.processutils [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/58ac7b8679e4503f114ae84b9e2cf5bd" returned: 0 in 0.235s {{(pid=88736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 10:47:04 devstack cinder-volume[88736]: DEBUG cinder.manager [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] Notifying Schedulers of capabilities ... {{(pid=88736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 10:47:04 devstack cinder-volume[88736]: INFO cinder.volume.manager [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] Deleted volume successfully. Aug 05 10:47:04 devstack cinder-volume[88736]: DEBUG cinder.coordination [None req-7109f11a-7331-4c06-ad38-a3d951bb2f64 tempest-ProjectMemberTests-1104312187 None] Lock "cinder-ed6f24f1-5648-4391-8a9f-8a8e471e8e0a-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=88736) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 10:47:13 devstack cinder-volume[88736]: DEBUG oslo_service.periodic_task [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] Running periodic task VolumeManager._thread_info {{(pid=88736) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 10:47:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread count: 28 {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 10:47:13 devstack cinder-volume[88736]: DEBUG cinder.volume.manager [None req-e3108436-dee0-4d8f-be58-489b19ef6d94 None None] thread info: [<_MainThread(MainThread, started 123457997066368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88736) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 10:47:14 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:SELECT=72,cinder:UPDATE=100,cinder:INSERT=25,cinder:DELETE=7 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 10:47:14 devstack cinder-volume[88736]: DEBUG dbcounter [-] [88736] Writing DB stats cinder:INSERT=30,cinder:UPDATE=107,cinder:SELECT=76,cinder:DELETE=10 {{(pid=88736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}